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This Study reviews the nev^ eoncepts for Technical Manua 
b«en developed and tested over the past twenty years. The 
those new concepts which have shown that personnel can pe rf 
Uss training when using chese new concepts. The proce^sas 
used by these new concepts to obtain better job performance 
are l.dentified, snalyzed, and summarized in a specification 
the best features of mch. The test results obtained with 
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•,pec i r i ca t i on of the procc-^-u?) uslilI in the new c-nncci^i^'p Thv; ^ iic c i f i i i (in , 
Dfdft M 1 L=H=632XX (TM) has two Part^i, ! arul M. Thry ruprcsent on i n t. oq ra t 1 on 
jf Techrnccji Hdrnjals (Pari ij einc Ti^iifiing {Pari \\) \r in one pacJ%J^,e whUh 
Ccin be used fur self pdcecl , >olf contained, on t ho |(^b I ra i n 1 nq ' wh i 1 e 
Lraineeb produce dsuful jun p rcduc :s . A sample manLhi 1 v/as produced under the 
sp{3C i f i ca r i on cover mq a turruL -.un^yst^^n^ C^f the H60A2 tank. A Lebl pUn 
for exper irnenta 1 and anaraiional tsb t& of JPMs was .il so duvo loped. Jho 
cif^ti^t s pec i f i ca f: i On , de'-g:Mbec} above, nnd thu scinn:ih* ^'nmal are ducumunLtid 
separarcly nna provided undtT '=Gn^irnta cnvnr to th\ rt^nnrt. The latter 
i s i d^n t i f i ed ^ - : ' ^-^^ 

SAMPLE TECHNICAL mANUAu 

TM 9-2 350"232-2^4H 
TM 9-2350-r32 = 2^ -.1 
TM 9-2350-232-2^^-3 
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coniUioc- pr::ni''M-. X": ^v^^r^''i-l< n cnniprnhpns i ve syste^natic investigation of 
^ivfc r^'a t'inn t :^^n -:Mnn ■'I'cn ni q^iL-^^ nov/ used nncl nronnsed tor use by nquin- 
ninrii: operatori ■^■^^^ArA'v Inforniation transnnssion techniques were 

evaluated within th/? puraine'cers of environment, task and equipment coniplexity , 
pnrnnnnel iraininr; -ind camDeLericta as they tinply. This study developed an 
in:Droved maintenance nroqrani v/hich could result in lov'sr niafntenance cost?, 
bi::tLOr relidbil i (:>■, and hiqher availdbility of Army niateriel. 

^oday the cost of owne^'Ship of equipment is higher than the cost of 
procii^Mng those items. There is a cultural lag in recognizing this state 
nf affairs. In earlier days v/e could properly think of the hardware item 
m an expensive investment to be protected by careful maintenance and repair. 
Today the cost of riiai ntenance personnel lias gone up, and hardware items ere 
so complex and have so niany parts to wear out and faiU that many more main- 
tenance personnel are required to care for them. One third of the personnel 
in Che U. S. Arniec^ Services are presently in full time maintenance v^orkl . 
and this does not include a^l the operators who do maintenance part time. 
The cost of these personnel is greater than the cost ofpequipment procurement 
in a year and is the major factor in cost of ownership. Replacement parts 
are another cost of ownership, but they are relatively small in comparison 
with personnel costs, so that when v/e consider costs of ownership, we must 
consider the ways in v/hich personnel costs can be changed. 

Equipment can be better designed for ease of maintenance, but this study 
does not explore, that approach. It traces what has been done that can change 
personnel costs directly- 

■ Thev-e are three v/ays personnel costs can be changed: 

T. By reducing non-productive hours spent in formal classrooms, 

2. By reducing v^ork force through improved performance on the job. 

3. By reducing false reniovals through improved performance on the job. 

There have been numerous "new concepts'' advanced in the last twenty years 
for improving personnel performances and reducing formal training time. Most 
of these new concepts have been developed in the Psychological, Behavioral 
Science community^ rather than in the Engineering coinmunity. They focus on 
changes in the personnel subsystem rather than on engineering changes. Much 
of this research deals with the software link between the hardv/are and 
maintenance personnel , Traditionally, this software link has been the 



Statistical Abstract of the United States, United States Department of 
CoiniTierce, 91st Edition, 1 970. 

^Manpov/er costs have increased from 37% of the U. S. Defense Budget in 1952 
to 47S in 1972 (Budget of the U. S.- Government) and the percentage in 
1975 is estimated, at 55-60%, 



Toclwiitnt Mafiiini, A CHi^tain cn-ouD of th& mvi concepts propose a n^^i niE^dium 
fo^^ thj:v lihU lincrofiLhH, ta^vn, Filiii ^'pcords, etc, Hov^^over. the 

irediun used for this ink nas little or no effect on the cost of ownership. 

'J. ^ the rnn:-??-! j r.-n^^n'- t i nn. nM' t-.^'^ '-i^^i\hr-- p .u:.^:r.r, {-^ l- ■■ ^ 

I. liancjQs pe'^f ai^niance on the ioh = 

''^h^ ne;v ro:;cepi:} iiiipuiM.jnCij hi^-^ii: -ai^p LOnceru^^d wi tli changinfj the 
i n'^Drr la ^i ofi thit M ov/^] ncroHS these links. It fs l)y changing the ' informa- 
tion that the nerfonnance of n^a intenaiici^ pei^sonnel and the requirefnents 
[Or fo)-n] schooling can be channecl This in tiirn impacts the three faxtcrs 
lisf:en ahovp nnd ^^nnsenuently thp co?;t^ nf ov/n^rsh1n. The p^esGnt st'K?}^ 
15 tl^siqried iQ exanrine al ! these new .loncepts, to identify elements of the 
concepts which have the greatest effect on changing performance. 

It has been ?^ecogn1zed that different situations may require different 
concept elements; it has also been suggested that some families of elements 
arp suited to some situations and not others; nevertheless, the aim 
of this study is to examine different situations in the Army with the inten- 
Mnn of tailoring n slnnle new concept to fit all situations, with variations 
f f reqijl red, 

Th^? objectives of this study were orpn iied into seven tasks: 

Task 1 : To identify new concepts for maintenance that hold promise fo^r 
reducing the cost of equipment ownership, 

'task Z: To analyze the new concepts in order to identify the fyndamental 
elements responsible for their effect upon maintenance cost. 

Task 3: To inatch fundamental elements to particular Army situations^ to 
eyahi^ite their validity, and to make broad cost projections. 

Task 4: ^0 review the fijndamental elements against the Commodity Systems, 
and project the cost of ownership which could accrue through use 
of these elements to produce all Army TMs. 

[ask 5: To prepare a specification which includes all the fundamental 

eleirents tailored to Army situations where they are appropriate. 

Tftsk 6: Prepare a sample manual based on the specification- 

Tas^ 7: Prepare a test plan for^ testing the sample manual. 

Inter ini reports were prepared on each of the above tasks during the 
course of the contract. This report summarizes and replaces all of th^ 
inter in task reports. The interim task reports are working papers each 
contributina to the next reoorts and the final report. 



!n ^hn ^\,ur\y provides a gi-'oss^astimate of the reduction in 

^•■nst ijf owne^^^^nip that .idoption of UiiG new lechnical Manual specification 
should suDport. ' ninre firer: 1 o f Iffia tre ivauld depend on factors v/hirh 
rliictuati? and exwrapn i a i; i ons rvom factors wtiic=h do noi: justiry such 
i^r^cviiou. In order for the potential reductions in cost of ownership 
to be reaiizr:d. the personiiel and training subsystenis must be changed, but 
they cannot be chanqed without the cnangii in information siipplied throucili 
the Technical Manual link; wg are. then, talking ahont a change in onc^ 
system that will have an effect across other Army systems. This is one of 
^-^^e ricst H-^^ficult rhfnn^^^s tn accnmnlish because th^ separate systems do 
not: forma riy "cQme together' below the^ level of the Chief -of-Staff of the 
Army. If changes in one command are to be coordinated with changes in 
other ccrT'inar.ds , high level coordination is required, 

Thounh chis coordination is not the subject of this study, the fact 
that the subject of low cost ownership cuts across cornmands is specifically 
recognized. It is a fact that has made change difficult in the past. This 
study is concerned with the technology for making the change possible. 
It does this by drawing together every relevant concept which has already 
been tested. In doing this, a single new technology is identified , which 
is an amalqaination of small scale studies in all of the services and 
industry. 'This provides the Army with the best of what has gone before, 
tailored to their situations. It provides the researcn community with a 
way of organizing in one study what has previously been discovered in 
separate itudies. conducted fpr different purposes in different situations. 
In the process, it resolves old argufnents and sets a new base from which 
to proceed. . The questions that remain to be answered are those that can 
be approached only through larger scale implementations that have never 
been possible with the resources of the research cDmmunlty. The results 
of the present study provide the Army with the best possible specifications 
and evidence for implementation. The implementation itself must be 
coordinated primarily between AMC and TRADOC and should be accomplished . 
with a concurrent research study to keep performance records. These records 
should provide the evidence for possible future reductions in work force 
based on improved performance. It will also provide evidence of possible 
.increments in performance as school training is decreased^ and personnel 
begin to perform more on the basis of information in the Technical Manual 
than on the basis^of formal school instruction. 

With this overview, the specific tasks and products of this study on 
lev/ cost ownership are now presented. 
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liudget.iii Ivg.; to imre tncu] ---^-^v^ in rMn = 

2, Therf^j ure approxiinai:^! v ]^^,noO p^M'Sonnel in the -i^^ 
and MiQchanical woii: for{>^; O:' Uie Af':;:y, This cost O'.' .-.n 

3, There are approximately 56,000 nev; Army p^rsonfial trMin^.-; each yea^" 
^or full time ma i ntenrince jobs in fornial scriools av^'vi^if!^; anuul: 20 v/oo^:^^- 
each and contributing approximately K2 billion (lollars annually no i.hr 
cost of ov^nership. 

4, Ther/^ is ample evidenco that a new approach to maintenance Technical 
Manuals -^nni reduce these co^.ts of ownership by about K7 billion dollars 
per year, and tv/o billion dr'nars v/ould not necessarilv be the upper 
rimit of this estimate. \ 

^5, The large reductions in costN^cme rrom a reduction in schnol training 
of about 75'; and a 15' reduction i^n the size of vvork force. Some smaller 
reductions rnay also be achieved by ^eductions in the number of false 
removals and the supply perturbationX they entail. No cost savings are 
seen for th^ manuals themselves, butX^heir cost is= only a very small 
fraction of the cost of tra.ining and work force. 

6. The new approach is based on a change in conception and assumptions 
about technical manuals. Instead of using training to provide the new 
maintenance personnel with general information which is combined with 
specific eqiiipment descriptions on the job, the new approach is to analyze 
all jobs and describe exactly what is to be done in the TM to maintain the 
equipment. The descriptions are presented in grapfiics and short words for 
a user with grade school reading skills, ^ ' 

7. The cha^nges required to bring about these reductions in cost of 
ownership require coordination between major commands, particularly AMC 

and TRADOC. ^ ^ 

8- The specification prepared in this study incorporates the fundamental 
elements from all new concepts which have proven their effectiveness in* 
the Army, Navy, Air Force, Coast Guard, and indir;try over ,the past 18 
years. It provides the Army with the best single approach for 
accompli shinq reductions in cost of ownership. 




■ ■. '"o- .(-;r i-- ! l : : 

■.:\C a' H T-l'-U.'C jo" ii^M; !'-^^^ /. '",:ip r : ilh \i on ancl pnrsnnnel 

v,-:-^'^:;: cnAfigf/s r : nr^-'^'.- o": a p i'in:: : : , e'.'l. , on one or mor^ new 
'ra'tjr itjK'^ i-:" r;/. -JO ^ t:uM cr !m.:, ile, and on One or inorQ 

-.^ : ; hi-." -on: 1 r / j-^ p::ir-fi t in the ^ rniv' inventory, e.g,, 
t:ML;'ed vehuJ selected cominun icati ons artinery cninputing equipntent. 

Tn^ o--L:^L ^cale iinDl^mentatlcns should be conducted by Army persDnn^l , 
K^;l- %^r.seurcM persnnnel should also be involved in data collection and 
iM^L projections over a period of years in order to gain more precise 
e^i-invn.i^:, than nossiblr fron] the small scale studies conducted to 
.r,t;p_ Trnn shnuld bp coordinated at a resaarch- 1 evel with similar pilot 
srctle ^:i;n 1 eriGntation being conductr^d by th€ Air Fo^ce. 

Plans sh&uld bo prep^ired for further larger seal e _ nnplementation based 
exDeriKnce gained in the pilot scale proyrains. This would involve 
production of new Technical Manuals for niany items of existing equipment 
and new equipiTient with the specifications being siniilar to those used in the 
Dilot scale impl ementations . 

4. Advance development research funds should be anocated to this effort 
ds it will require some kinds of rTiodification and improvement. As the 
scale of operations identifies new probler^s, e.g., reducing the number of 
MOSs as personnel can effectively Derform a greauer variety of jobs, and job 
relevant testing of personnel for advanceinent , new solutions will be needed 
to capitalize on these potentials. Also^ such studies will be of v^alue to 
other^ services and industry as well as for setting priorities and implemen- 
tation schedules within the Arfny. 

5, Personnel with research eKperience in 4}r\s fiela should be retained 

to help guide pilot scale impl enientation effort. This should include help 
to the Army procuring agency and to the rest of industry which must learo 
new methods for meeting the new specifications. 
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, TASK 1 / 



A . Gen eral D1 scussion 

New concepts that claim to Improve transmission of maintenance Infer- 
mstion from rnanuf acturer to user were identified in this study and analyzed. 
They range frOFn ideas published in a company brochure to fully developed 
and tested techniques. The first analysis of new concepts was^ to Identify 
those which dealt only with media (photographic and electronic techniques) 
and not the content of information transmitted over the media. This was 
the first analysis because the fnedlum of transmission of information does 
not appreciably affect cost of wnership, the study objective. There can 
be no further analysis of media 1n terins of their effect on cost of owners- 
ship, because ^JfilS have no effect on cost of ownership. The- appropriateness 
of any transmission rnedium for Army situations depends on power and 
mobi lity char.acteri sti cs of the equipment associated v/ith the mediae not 
cost of ownerships None of these nev/ concepts which dealt with media had 
any test data to demonstrate any advantage over traditional paper technical 
manuals. Essentiany all ^the techniques of informati en transmission that 
do affect cost of ownership can be used over any niedium* 

When the term new concepts Jn maintenance 1s used hereafter In the 
report it refers only to thos^ that have, a potential for affecting the 
major costs of ownership^ the personnel subsysteiri. 

Ail of these new concepts promise to improve maintenance through improved 
performance of maintenance personnel. There were no other criteria for 
inclusion in the survey. It is believed that tHe survey included v1rtuai:i> 
all the new concepts, and it certainly Includes all the major ones. ^The 
survey portion of the present study did not uncover any important new 
concepts ^.ha|. had not already been identified by others. 

The survey format Is not adequate to provide a brsakttfrbugh in this 
field, Surveys merely describe^ they do not: ibresti a structure for reducing 
all results to a coiTinion forni which Jc<in-^W'used^ to strticture the next steps. 
Advances can only come fr:om--r«dl}bing existing data to some kind of cornion 
form , ---- ^^^^^'^ / ■ 

Therefore^. the survey portion of the present study Is n^ot the Important 
step. 'It Tnerely provides the groundwork for building a structure and 
reducing data to that structure, 

From the survey it is clear that the Inexperienced soldier is the focus 
of most new concepts, The new concepts involve Job aids for the most 
.part, though training is also included in some. When training Is 
included, it is for a functlQnal understanding of the equipnient and not 

1 



for design lewel understanding. The focus is the new man on' the job, who 
is assurried to be untrained or" trained only at a functional level. 

It is because of this focus that the new concepts have such a large 
impact on cost of ownership, The high costs of ownership are in the new 
man, his trairiina and first year on the job. It is these costs that the 
new concepts piavi demonstrated a capability for changing. An eKpirienced 
man's pmfcmmc^ cannot be drafriati cally improved because he is already 
operating at 3 relatively high level, If the new concepts also help him, 
this oiust be considered as a^side benefit. Desirahle as this niight be, 
it does not greatly affect the cost of ownership. 



B L ^2_Sld^e_ 

The procedures for collecting data on the new concepts were as follows: 

1. Copies of reports of new concepts in company files were first 
CDlleCted. ■ This produced about 852 of the total list. 

2. Reqyests were made to the Defense Documentation Center (DDC) and 
flationai Technical Information Service (NTIS) to provide infonnatlon 
by Subject matter, This produced relatively' little new data 

(abou t z;; of total). 

3. DDCand NTIS were requested to provide inforniation by author. This 
reqiii red pri or knowledge of what authors to request, It updated 
infor^i&tion but provided no new concepts (01 of total) ^ 

4. Parti al lists of new concepts included in about ten other reports 
were examined. Most of the items in these lists included 
unverified sources given in previous reports. Original copies 

of reports were requested, froni all originators for which no 
. rater iai was on file. This provided information on some new 
coiice pts (about 82 of total). 

5. Parsonr:i1 contact was made with personnel who have worked in the 
field {5t of total). 

6. There refrains a short list of new concepts which have been reported 
by naJ^ in other reports but on which we were unable to collect 

any i nformation , Telephone calls and letters did not reach the 
sources given in other reports. The sources , .-therefore , remain 
un verified. 

No research results are included in this survey that did not come from 
a verified source. It should be added that this criterion did not exclude 
any data. No reports cited any data from unverified sources - only the 
existence of a nevg concept. Therefore, it may safely bejssumed that all 
data on the new concepts ^has been collected for this report. 

14 
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There have been se\mra1 prsvinus survpys of this field, The earliest 
were bv Shriver and Trex?f r in ] , and a compendiuni of concepts prepar 
the SMC Equipment Manuati Field Office (EMFO) at Lett^rktnny' Army ucno 
196 52. \ - ^ ' 

More surveys have fol lowed, ^ut all have described the concepts 
without reducing theni tu the fundantental el enients responsible fo^' xh^i'-^ 
results; The present study uses the"''survey only as a small first st^p. 
The Important steps are described in the . tasks which follow. Without' 
those steps the survey phase can be said be mi si eading rathff r than 
enlightening. It identifies so many seemingly conflicting ^orniats ana' 
intentions that any reader must say the field is not yet ready for 
implementation, The results of many studies .1 ndicate important potential, 
But there is no single clear action that v;i 11 achieve the potential 
effects. Purveys perpetuate this indecision. They'wnnot clarify, they 
only add a few Friore items to a clutter of seeininglv different concepts.: 

A list of these concepts appears as Appendix A, 



"Shriver, E, L., and Trexler, R. D. A Description and Analytic D iscuisjorL 
pX__IlOie^_CQ^cepts for Electronics Maintenance. Technical Report '66'--23, 
Human ResDurces Research Office, George Washington University, Alexandria 
Virginia, December 1956. 

2 

rechnic a^ Regort SMC EMFO lU Im proxgd JIa intenan ce Data Tech nig 
ImprovefTients Branch, Guidance D1 vision, SMC Equipment Manuals Field 
Offices Letterkenny Army Depot, Chamber sburg , PA. , 15 ALKjustn955. 
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Otf n r- f-a 1_D|s cus^ij)n_ ' ■ ■ 

The purpose of Task 2 was to analyze the various new concepts idfin- 
tifleri in the surveys and identify fundamental elements which would 
account for the results obtained from using those concepts. An initiaV 
set of f undc^.niental elefnents was idsntifi^ed in the project proposal, and 
each new concept was initially defined in terms of those elements; when 
a qoncept was found which could not be described by the fundamentaT 
elements in the initial list, a new element was tentatively defined to 
describe it, or an old one was redefined, This vfas done through 
iterating entries in a matrix of concepts by f undarTiental elements. 

In the pe'rforfnance of this task, the initial list cf fundarnental 
elements was eKpanded^ priniarily as a result of redefining or reorganizing 
the original elements^ rather than of adding new elements. This 
definition is referred to as "changing the boundary conditions" of the 
fundamental elements. For Instance, the original fundamental element 
of "Plain English" was redefined as "Intelligibility's thus including 
information given in graphic form as well as in wTitten words/ 

In performing this iteration of fundamental elements , each of the , 
nev7 concepts was defined in a set of comrnon terms. 

The iteration process wa^^ accomplished with a .matrix 9f fundamental 
elenients by nw concepts. The entries were iterated several times. A 
niatfix was prepared which represents a descr^iption of each of the new 
concepts in terms of the fundamental elements used tp make them effective. 

At one point it was thought that the concept which embodied the greatest 
number of fundamental elements would be found to be the most effective, 
iAs the matrix was iterated, this was found to be a naive idea: the mere 
presence of ,a fundamental elenient did not ensure that it was efficiently 
developed, For example^ every concept uses "Plain English" to some degree, 
but its intelligibility^ may be severely limited. One concept studied is 
intended to provide information in "Plain English" for the experienced 
rnan. The Information consists of concise readings at key points in the 
system, and the notation for special settings for contents for certain 
test conditions, There are no procedures to tie the readings and the 
settings together. To the experienced man, the data is plainly and 
concisely presented in "Plain Engl ish" , -but to the inexperienced man, 
the data is unintelligible. In another concept the procedures for using 
such data are included in the documentation and are intelligible on any 
level. Both concepts can legit imately.. Be described as using some form 
of "Plain English", but the first is intelligible only to a limited 
audience. 



When decisions arising from such dilemrnas had to be made as to whether 
or not an element was sufficiently "present" to be placed 1n the matrix, 
it was ^r^ecognizi^d that it was not the presence of many elenients which made- 
a concept effective, but the thorough developfnent of a few. Whan an 
originator sets out to improve technical docufnentation, he may do so in 
tlie name of "readability", or '■understanding" or "full proceduralization". 
In all cases this means developing that element more than has tradi- 
tionally been done. Every Technical Manual has soma degree ''of procedural- 
izfltion, every one provides sone undev^standing i some Plain English^ some 
content analysiss etc., but the really successful new concepts were found 
to have one or two elenients present in a fully developed form. 

When v/e Took at the results of task 3-, we find that alinost all of the^. 
research results have been conected from a relatively small number of new 
concepts ^that have some eltrnents fully diveloped. Other concepts represent 
only "good intentions" or partial developnients , For instance, FORECAST 
and SIMMS concepts utilize very fully developed block diagrams for 
understanding. Their block diagrams have bean developed for dozens of 
systems; the rules for their construction have been defined, and they have 
been tested with thousands of rriaintenance personnel andj^efined through 
succassive iterations. They are fully developed aids to understanding and 
performing troubleshooting. ATOMS and other .:new concepts also utilize 
block diagrams, but the ATOMS concept is represented only in a few pages 
of a cDfTipany brochure; the block diagrams are eKamples only of intent, 
the AJOMS concept, then does not add anything to SIMMS and FORECAST. 
ATOMS is actually subsumed under them as a less developed form of each 
fundainental element. Other new concepts that utilize the same elefiients 
are also subsumed under the prime concepts. They are not in competition 
with the prime; they merely represent supportlng-ievldenca for the fully 
developed form of each fundumental element- ^Any new concepts . that are 
developed or have been missed in this survey can be subsumed under the 
fully developed fundamental elements of the major concepts. 

Task 2 was extremely useful for revealing the notion of "fijlly 
developed". It had not been recognized previously as an organizing 
principle. This principle^ coupled with the redefined fundamental eleme-nts 
organizes the entire field into a meaningful picture. The issues opened 
up in Task 2 are resolved in Task 3, vs/here evaluations are accomplished 
in conjunction with results. 

B. Specif j_c AjL^j^^MS R^^^ 

The various abjectives of new concepts are summarized in the following 

list: 

0 To rniprove Technician F'erf orniance 

0 To ' ■iiprove/Reduce Technician Training 
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o To Reduce Technician Skill Level Requirements 
o To Reduce Equipment Downtime 

Thpse obie^tives are cnncerned with the. .personnel and traini ng subs^/steiiis 
Through these systems they have the poteritial of affecting cost of ownership, 
The results "of the researcH studies are in terms of the objectives listed 
IbDve' and costs of ownership are projected from them. These projections 
are rtiade 1n Tasks 3 and 4, ■ ^ ^- 

The. original list of fundamental elernents, hypothesized to account 
for aVl of the results obtained with the concepts, is as fol lov/s : 

1 . Task Analysis 

2. User Pbint of View 

3. : Efficiency, of Task Analysi s/Log 1c Trees ■ / 

4. Assumed Knowledge .and Skill 

5. Understanding Versus Rote 

■ 6. Plain Engl ish ■ ^ 

7^ Psychological Motivation - 

a. Mediuni of Presentation 
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The initidl orgdnlzifig f r^dmewor k, f or these fundamental elements was: 



Task 
Analysi 



User Po int 
of Viavi 



Eff i ci ency of j 
Task Anal ysi t 
and 
Logic Trees 



Assufned 
Kn owl edge 



find SkiTl ' 



Plain 
English 



7. Priychological 
Moti vation 



.9 , Fi na 1 Documentati on 




Medium of 
Presenta tion 



This framework means that Task Analysis (1) is performed on the subject 
e-quipment. The User Point of View (2) is used in niaking this analysis. 
The efficiency of the Task Analysis and the resultant Logic Trees (3) is 
a function of the procedures used. Since the trees represent a very 
inefficient set of steps for doing the job^ a set of efficient procedures, 
i^s to be selected for use here. The Assumed Knowledge and Skill elenient (4) 
is the basis on which the details. of the prescribed step are determined. 
For instance, if it is assumed that a user knows how to remove a carburetorj 
the step need only say 'remove carbjjretor but Jf^nots the step must be 
broken down to '"remove air filter^ disconnect gas linej etc," ^Likewise^ 
the steps can be broken down for "disconnect gas line" to "place 1/4 inch 
open end wrench on nut l^ turn counterclockwise, etc." The assumptions 
[Tiade on skill and knowledge of the user detennlne the level of task step 
detail which the Task Analysis goes into, 

The framework has Understanding versus Rote (5) as a decision and also 
an optional method of treatment after the basic data is analyzed. It 
means that the data can be organized for understanding (at a functional 
Block Diagram level) or for a series of procedures for rote performance 
with no understanding.. 

After the analy?ed data is prepared for Understanding or Rote^ there 
are additional processes to perforni before it is placed in a technical 
manual. 
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All written material should be put in Piai.i Ing 11 sh (6). This means _ 
preparing it so that it is comprehensible to the user population. If it is 
prepared^properly in Plain English, It will pass readability standards. 

. Psycholoql cal Motivation (7) is any technique for making the content 
interesting to the reader. This is typically done bv incorporating graphic 
des/ices aud color. This has been caried the comic book technique by _ 
decractors, but it has good user acceptance. This tan be done jn addition 
to putting the content in Plain English, The third technique option listed 
at this level of the framevjork is the medium of presentation (8) ; e.g., 
paper, film, .Tiagnetic tape, etc. 

Using the matrix For successive iterations resulted in the foil ov^ing 
redefinition of the original eight fundamental elements into fifteen 
elements, to 

The first three or i g i na 1 elements were .redef I ned as four types of 
analysis that had been used effectively In various toncepts. They are 
described as four types of content analysis: 

1. Equipment Analysis 

2. Functional Analysis 

■3. Task Anal ysis ' ' • 

U, Behavioral Task Analysis 

Those analyses are all processes that have been used to generate job 
aids and training In some new concepts. They have been well developed 
in one concept, or another, but havfi never all seen used in one concept. 

The fourth and fifth original elements were changed into: 
1. Procedu tes 

a. Serial 

b. B ranch in g 

2* Funct lonG i Understand i ng 
a . T ra ini ng ' 
Narrative 

c. Graphics ' •. 
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These represented nieans by which certain nev/ concepts had achieved 
either Understanding or Rote, and -this in turn required asstimptions about 
how much skill and knowledge the user had in order to use tlie docunientation 
provided. Those new concepts which used prbcedures for rote performance 
generally assumed no special training for the user* Those that used 
training with the documentation assumed the user would learn certain 
equipment functions in that training - but this was quite d1ffer.?nt from 
the training content of traditional formal schools. 

The original element of Plain English was changed to Ijitellj g i bil ity , 
and inciuded: 

1 . 1> inipl i fieri Text 

\ 2. Text/Graphic Combinations 

3, Organized Formats, to Support Multi-User Performance 

These were seen to be ways which certain new cancepts used to achieve 
simplified content. The use of graphics and English words required that 
the terrti "Plain English" be changed to a term such as '*Inte11 igf bi 1 ity''. 

The seventh original element was expanded fronn Psycliol ogi cal Motivation 
to Moti vational G raphics ^ and included: - ^ ■ 

K Motivation Graphics 

2. - Personal Involvement 

3. Color Graphics 

The first and third new elements are graphic techrn'quBS. The second 
involves the use of personal pronouns in the accoinpanying text. 

This, then, is the list of elements for evaluation in Task 3: 

' 1 . Content Analysi s • 

a. Equipment Analysis 

b. Functional Analysis 

c. Task Analysis 

d. Behavioral Task Analysis 
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2. 



Procedures 



a^. Serial Procedures 



Branching Procedures 



3. Functional Unde rstandinq 

a. Training ^ 

b. Narrative ^ 

c. Graphics 

4. intenigibni ty 

a ... Simpli fied Text 

b. Text/Sraphic Combinations 

c. Organized Formats^to Support Multi-User Performance 

5. Motivational Graphics 

a. Motivation 'Graphics 

b. Personal Involvement 

c. Color Graphi cs 

- It is not the final list, since as a result of that analysis.^ 
fundamental elements were again redefined (Task 3). 

X , Definition o f El einents 
1 , Content Analysjs^ 

a. Equipment Analysis 




(LSAR) (formerly known as MEADS) information, 
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tasks of oprirdbing I'm iiuou ofiu /-(jniuv ifi^ a"ir filter be ■cornpieted DeToi^ti 
the major task is perfonnad. LiKewise, ta:ik$ such as going to get lubricants 
parts,' etc., are annillary to niajor tasks. Thf^se ancillary tasks are 
idgntified by the analyst in a Tack Analysis aftar he receives the assign- 
nient of analyzing -a job task. The term ''job task' is used to refer to tin 
tasks identified in the Equipment Analysis. The ancinary tasks are 
called '■subtasks'S and are identi f led' as behavioral objective!^ in the 
Task Analysis process. 

The Maintanance Allocation Chart (MAC) is m example of the suininarv 
output of this Equipment Analysis process. Far troubl eshootinn maintenance^ 
the f!AC is used to verify that the functiofiel analysis (described below) ' 
is complete. For non-troubleshooting ma1 ntenanca / the MAC is used to ■ 
generate a comprehensive list of tasks by readinn off the .intersection of 
maintenance functions with component assefnblies^ Including associated 
Group Nunber, Tools and Equipment, and Remarkl, The ultimate source 
document for this analysis is the engineering drawing. Questions about 
specifications and tolerances must be reSQlved by referring to this document 
and products not consistent with this document are 1n error. 

rjo te : The Army is the only service to produce a product like a MAC, 
In the other services this product must be produced by the personnel 
preparing the TM. This product of this analytic process is called the Task 
Identification natrix (TIH) in the Air Force. 

Modification of the MAC, per se', is not a technical manual development 
respons ibiTI ty . Inconsistencies in part-stocMng and distribution, etc., 
which may be revealed by the other analytic process, are treated by celling 
them to the attention of the system design shop. It should be noted that 
these inconsistencies must be cleared up before the manual can be finaVrMd, 
Any Information from LSAR (formerly known as MEADS) is source infornnatlon 
for the "^M developers. 

b. Functiotial Analysis - Troublesh ooting Task5_0ni1y. A Functional 
Analysis is performed for troubleshootin^T¥$KiT^ 

(1) To develop an understanding of system functions and subfunctions 
and how they are related in the equipment thraugh functional block diagrams 
and functional descriptions, 

(2) To identify all the Inputs and outputs oP the blocks, and show 
how to measure them, 

(3) To Identify symptoms of abnormal equi Foment function that are 
associated with each block. 

(4) To allocate parts to blocks so^that the failure of any part 
assigned to a block v*/il1 not affect the measured input to the block, but 
only the nieasLi red output, 

2U 
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"^he functional des^^^iptlnn- say w^^h^ what the functions of each 
of the' blocks on the block diagrams%re. This is not a recapitulation of 
the theory required to design the systeni; it describes how the equipment . 
functions and indirectly Indicates where the user should look when it 
malfunctions- It is man-oriented, not system-design oriented. It employs 
simple, understandable concepts CDuched in Plain English. It is more 
concerned with what is understandable than with what is true in terins of 
competing theoretical or engineering positions. It is coordinated with 
t-he functional block diagrams generated for troubleshooting purposes. 
The boundaries of troubleshooting functions are not physical boundaries 
or design engineering boundaries , but are the boundaries that make 
troubleshooting and maintenance most effective and efffcient for the 
human beings doing the maintenance. 

The trouble?hooting block diagrams take into account the block 
diagra:ns generated for design purposes, but their final boundaries are 
established in the Functional Analysis, including examination of the subject 
pquipmentL The analysis must be a "hands on" analysis. 

These paragraphs are not sufficiently detailed to convey the rigor that 
this analysis must entail . This analysis takes into account accessibility, 
probability of failure and dlscriminabil ity. 

c , Task Analysis - NQn°troub1es-hoot1 ng Tasks and £roceluraXj5^^c^ 
of Troubleshootinq"TaskiT" The Task Analysis converts the job tasks 
Tcientified in' the Equipment Analysis to the series of tasks and steps 
required to get that job task accomplished. The MAC lists the parts of 
the equipment and^ what type of maintenance is needed on each. Task 
Analysis is concerned wi th the conversion^ and organization of maintenance 
tasks, into performance sequences of steps. The job task of replacing a 
carburetor is defined as a series of tasks includirig raising the hood, 
removina the air filter, removing the gas line, etc. These data are 
developed by the analyst from the experience and information available to 
him, rather than by the soldier on the job. It is new data, not a 
recapitulation of information developed by design engineers in describjng 
the equipment. Later, in Behavioral Analysis, these tasks are confirmed 
and developed into more detailed graphic and written instruction by a 
'^hands ori"^ performance on the equipment. Notes, cautions and vvarniilgs are 
identified, specified, and inserted at the appropriate places in the task 
structure during the Task Analysis and Behavioral Analysis, 



TB 750-93-1, Functional Grouping Codes, represents engineering functions, 
not the troubleshooting functions described here. 

■Shriver, E. L,, et al. A Procedur al Guide for'Technical .Implemehtatlon 
of the FORECAST Met hods of Ta sk and Skill Analysis. Training Methods 
Divisfon, "Human "Resources Research"Offi ce7 George Washington University, 
Alexandria, Virginia July 196K . 



17 



The user population for whom these procedures are intended includes' 
the novice with no experience or training on the subject equipment. The 
task step procedures for every task are prepared. 

d. Behavi oral Task - Analysis . Behavioral Task; Analysis is con- 
cerned with human sensory perception - with what can be seen, heard and 
touched. Maintenance personnel are the users of maintenance documentation ^ 
and as hunian beings, they come equipped with certain sensory capacities. 
Those sensory capacities are immediately available for use in sensing 
deficiencies in the equipment^ and are often easier and faster to utilize 
than test equipment* 

Behavioral Task Analysis elicits from the hardware the cues (from 
various side effects or from intended displays) which the user wfll use 
to find sources of trouble or to perform a sequence of steps. What the ■ 
user will actuany nee^ hear, etc, , is an important part of the analysis. 
In mechanical situations (serial) the sensory capacities are used in making 
inspections and checkQuts, The Behavioral Task Analysis should ensure 
that, the distinctions between acceptable and unacceptable situations are 
adequately described in behavtoral/sensory terms so that the maintenance 
personnel can make the correct discrimination in any given case/ 

in troubleshooting situations the Behavioral Task Analysis must "look 
ahead" to what lies along a given branch. If the collection of sensory 
information on all alternatives is not equally easy, sensory discriminations 
should be programTied in the order that they are the eaisiest and fastest 
to obta^n^ Equally, where branching 1s Involved, sensory discriminations 
that are too fine should be avoided; that is, the boundary for functional 
entities should be selected as a function of the ease of making an effec- 
tive measurement at the output of that function, This fundamental element 
involves "trade offs" that are functions of human characteristics. Along 
with these -'trade offs" is another factor which involves the probability 
of a failure being In any particular place. For Instance, if there is a 
very high likelihood of a failure at an inaccessible location, then 
maintenance personnel should be directed to that location sooner than if 
it had parts that failed only infrequently. So, although probability data 
has no similarity to human behavioral considerations, the probabilities of 
machine "riii sbehavi ors'' must be traded off against human characteristics 
at this point. ' 

In practice, >the Behavioral Task Analysis always looks for the simpler, 
more efficient way. This means simpler In terms of cues, discriminations 
and the behavioral responses of personnel. This is not an engineering 
analysis^ and only starts with the hardware features of the system. ^ 

The Behavioral Task Analysis product includes what some of the concepts 
have called a mal functional analysis. If, for example, the plates of a 
B+- rectifier will glow red shortly after warmupM'f there is a remote short 
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on the B+ Une, whereas they w 11 arc and spit immediately If there 1s a 
short in the output' f nter, then these cues artd discriminations should be 
elicited by the Behavioral Task Analysis. There will be no record of such 
information in the engineering des1 gn, sheets but this information is what 
a human being uses to perform an effective job.,. 

Since relationshiDS such as this are clearly not derivable from an 
analysis of function only, the. Behavioral Task Analysis should not be, 
conducted sequentially, but in parallel with the Functional Analysis. Thus, 
it is the information from a Behavioral Task Analysis (BTA) conducted side 
by side with the Functiorial. Analysi s , that provides the basis for bunding 
task sequences around di scr im nabl 1 1 ty cturi n g the task organizatioral phase. 
Cues which cannotreadily be described In the BTA'may have to be rejected 
for, usp'.in the Functional Analysis. For instance, an "igniter in a jet 
engine makes a shapping sound like tv/o screwdrivers being struck together 
while being held by the blades. This is a very useful troubleshooting cue. 
The description given above represents an effort to describe the cuf. _ 
Once recognized .it is highly discrlminabl e. But some cues are so difficult 
to discriminate that a "hands on" analysis of the equipment 1s essential 
for the Behavioral Task Analysis. It 1s desirable to do some of tins in 
tandem with the Functional Analysis. It may require more experience on the 
part of the analysts to do this than they wi 11 possess initially, and it 
may take time to develop this level of sophistication. 

Z. Procedures. Deleted (Task 3, paragraph CI). 

3. Functional Understanding. Deleted (Task 3 , ' pa ragraph Cl ) . 

4. Inteniqlbility. Redefined (Task 3, paragraph Cl).^ 

5. Motivational Graphics. Deleted (Task 3, paragraph Cl), 



D. Summary • 

The major finding of Task/z was that the fLindamental elements exist 
'in varying degrees in each concept: rudimentary, highly developedj or 
any point in between. This was found during the process of entering the 
elements from each new concept In a matrix, ard iteratively redsfinlng 
and re-entering them in a new tnatrlx. This finding is further developed 
•and resolved in Task 3. 

A second important finding was that the nwfnber of elements in a concept 
was not an Important detenniner of results. It was Initially believed 
that the concept which had the greatest nuTuber of elements would he the 
most effective, but In this task it was recogrlzed that the degrea of 
developinent of an element was more important than the number of elements'. 
This finding is further developed and resolyed in Task 3 which evaluates 
the results obtained with the new concepts. 
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Task 2, then, rusuitt-d in a definnion of fundamenta; eieirients, vv'mch 
was the prime objective. However, the important findings of the task 
concGrned breaking with the precOfic6->r./ed notion that the quantity of the 
fundanientai elements represented in a new concept would determine it^ 
effectiveness. In resolving this reassessment, the elenients in Task ? 
were reduced in number, as indicated in Section C of the Ta^k ? desr--i-,tin 
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TASK 3 



w t yj V :: w i V K: :i 

T[^ef0 were four nid i n objectives of this task: 

0 To exainina individual Arniy situations and determine the appropriate 
elements for each, 

0 To make a comparativG evaluation of the f undainental elements 
identified in Task. 2. 

0 To evaluate those concepts listed in Task 1 which had no appreciable 
effect on the cost of ownership. 

0 To project, broadly, changes 1n cost of ownership. 



1 . Matching Fundamental Elements to Situations . 

Before this study started, there was a strong belief that each of 
the new concepts was tailored to a particular environment or situation 
in the various services. It, therefore, seemed necessary to identify and 
match specific situations with appropriate fundamental elements from the 
new concepts „ During the process of performing this task, it became clear 
that the orlainal belief was in error. Only two basic situations were 
found for which different fundaments! elements were required: the^ 
troubl-f^shooting situation, and all other maintenance situations (non- 
troubleshooting). This had to be checked against specif ic Army environ- 
ments in the next task, Task 4, but these were the only two situations 
(across services) which appeared to require different technological 
processes for developing information in manuals. 

2. Evaluating Fundamental Elements . 

Before the task started, there was a common belief that evaluating 
the fundamental elements (technological processes) would be like comparing 
apples and oranges. The basic problem was that there had been no experi- 
ments made on the individual technological processes used 1n each new 
concept. The new concepts had always been tested as packages. Conse- 
quently, it was difficult to see how any of the separate parts could be 
evaluated, let alone compared across different concepts and the situation 
for which they had been developed and tested. The answers to that problem 
which were developed in this task now seem simple and obvious, but they 
were not obvious when the task was begun: the questions had been plaguing 
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the field for years. The deceptively simple answer came only through a 
long prnf:e$s of trial and error analyses in the present study. A sunm-^-y 
is provided below which leads from the initial problem to the final 
conclusion in logical steps, rather than in terms of the trial and error 
steps. The logical steps were designed to answer the following questions: 

a. What is a fundamental element and what are its boundary 
Condi ti ons ? 

When this study was initiated, anything that was found in any 
of the new concepts that improved user perfonnance or lowered training 
time was called a fundamental element. This was still true at the 
conclusion of Task 2. At the end of Task 3, however, a fundamental 
element was no longer a "thing". A fundamental element was now recog- 
nized as a technolDgical process for producing a new type of TM, each 
process converting one kind of information into another kind, 

b. What kind of fundamental elements are needed 1n order to 
prepare an integrated specification? 

Four of the fundamental elements are analytic processes. The 
fifth fundamental element utilizes stored information and techniques as^ 
part of the process for converting the results of the other four analytic 
processes into intell iglble information for the grade school reader. 
All of the processes are used for troubleshooting tasks, while functional 
analysis is omitted for non-troubleshooting . tasks , 

c. How are the best fundamentaT elements selected on the basis 
of the results of the individual studies? 

In this step, the fundamental elements were defined and evaluated 
in the following terms: 

0 Did use of the concept result 1n improved performance and/or 
lowering training time? If so, how much? 

0 Were one or more of the fundamental elements more fully 
developed than others in the concept producing the best 
resul ts? 

0 Were there any fundamental elements which were well developed 
but did not produce good results or v/ere not tested at all? 

The important thing that was recognized was that tJie technological 
processes called fundamental elements are not in conflict with each other, 
that every conceDt uses some form of each, and that the^best results are 
obtained when one or more is fully developed. With one exception, the 
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fully dPveloped form of a fundamental element always had pod results 
associated with itJ In retrospect, this can be seen to be a self- 
v^lPctivr" pfocfiss. That is, there are few reports on technologica 
Drnces^e^ that didn't work. The key to the evaluation was the results 
obi-r-ined. Every conceDt with aood results was found to have one or more 
fun.-iaiiiental elements in a thorouqhly developed form. It was therefore 
deduced that thfi fundamental elements which were well developed must be 
rhe facto-s producinq the good results from a given concept. For instance, 
roncept A produced qood resuUs. It had a well developed form of Task ^ 
Analysis (on-.; of the fundamental elements). It had a rudimentary i orm oi 
makina text i fadable (another fundamental element). Concept B also_ 
produced aood results, but it had a rudimentary form of Task Analysis and 
a fully developed technique for making text readable. It is a logical 
deduction that it is the fully developed form that is responsible for the 
good results in each case, and that an improvement in only one fundamental 
element can produce good results. Each fundamental element selected for 
inclusion in the final specification has proven itself to be the effective 
ingredient in one new concept study or another. 

The second part of this step was to answer the question of wliich 
fundamental elements in a fully developed form are more effective than 
the others? It seemed initially that an answer to this question was 
needed in order to choose between them. For example. Task Analysis 
produced greater improvements in performance than did Intel ligiblTity, 
but on reflection it became apparent that both are ■desirable , and that 
neither is in conflict with the other. This important point was not 
apparent when the study started; there had always been a conflict in 
peoples' minds over which single concept should be adopted, which seemed 
to be solvable only on the basis of which concept produced the best 
results. But when the concepts are broken down to their fundamental 
elements, it becomes evident a single Integrated concept should be 
designed in which all the fully developed elements are incorporated to 
the extent they are not in conflict. Each one that has been shown to 
be effective in one concept or another is a desirable component of an 
integrated concept. There is no need to say which _is best. We just 
use all which have demonstrated a value. 

At one point in this task, problems such as the following required 
resolution. One concept had resulted in a 401 reduction in training time 
a-nd another had shown a 60% reduction based on development of the same 
fundamental element. Which presentation of the element should be used 
in' the integrated specification? This turned out to be no problem; it 
was the same fundamental element, the same process in different stages 
of development, and we, therefore, use the most fully developed form -- 
the one that has the most precise specification and/or description Of the 
process. 

3. Evaluating Ineffective Concepts . 



third objective of this task was to evaluate the concepts 



Hhe Maintenance Dependency Uiart (MDC) is the exceotion and it is discussed 
later in this section. 
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(listed in rask 1) for which no axpernmentai resuUs eKist. It was found that 
concepts which do nf)t affect ownc^rsh.in costs do not have well ri^velopeci 
fundamental elenientb. ihu.}' ar^e qu!it:irj; i i y al Lhe U:vui err dc^vtil opiiiant o: 
a company brncluire. They advocat^j Task Andly^is ur Bloci. jiayraftis or 
improved readability, and they may snow sonic e;^'Cii!p^*:!!; . but th^^y do noi 
provide the details on the teclHiologi cal procGSAeij hir d^^veloping the 
fundamental elenients they advocate. Their advocacy points to the inipGr- 
tance of these elements, but it contributes nothinq to the^r dovelcpmeMt. 
Consequen tl y 5 these new concepts can be snh^ui^^ed und^r fhns^ '•>^'r.ck riid 
develop one o^ more of the fundamental elements. ["heir presence shuui ! 
not be alTov/ed to confuse the evaluation picture. They rire not contendinq 
for implementation, but merely point in directions that have been 
developed in other ooncepts. These concepts are described ir ApDendix B 

^ . De veloping Cos t of Ovv neT^shj^ P rojections , 

The fourth objective was to translate the results obtained in 
various studies into common measures which could be used with cost data 
to project changes in cost of ownership. For this purpose the results 
were reduced to the following. 

a. Rediiction in training time. 

b. Reduction in size of work force. 

c. Reduction in false removals. 

This was accomplished in this task and the results carried forward to be 
combined with costing elements in Task 4. 

Approach - G £neria_]___ 

Task 3 marked a major milestone. It was the first point at which a 
complete outline of the final specification became available„ The outline 
was subject to further confirmation (in Task 4), expansion (Task S), 
application (Task 6), and Test (Task 7). Nonetheless, it represents the 
first "rough cut" at a final product* 

Tasks 1 and 2 were deliberately expansive 1n nature. That -is, every 
effort was made to identify all possible concepts, elements, categori- 
zations, etc, 3 |hat might conceivably bear on maintenance documentation. 
Task 3 marked a^turning point in orientation It began the process of 
closing off options and consolidating them. The fundamental elements 
became better understood, and their number was reduced to five. . The 
results v/ere consolidated into three categories for projecting costs ^of 
ov/nership, and " ownershi p costs were analyzed and combined with results 
to project the costs of ownership that could be changed by the use of the 
combined integrated specifications. 
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1 . Jerm h of Resul ts 

Thu /asults obtainuid witi^ each naw cnncspt were gf^rit^rn 1 i zfed across 
all Arr.y situations, Specificany, the reaults were reduced to those 
COnCi^rnnrl with: 

'■■eduction in training time 

b. Reduction in work force 

c . . Reduction in false removals 

2 . _ BQunoary C onditio ns of F undamental E lements 

Based on these analyses a better understanding of what was effective 
in producing results was developed, and the fundamental elements were 
ncccrdingly redefined. Some elements broupht forward from Task 2 were 
deleted, and the boundary conditions (or definitions) of others were 
changed. It was finally recognized -that the fundamental elements are _ 
processes for producing the documentation in the new concepts. Five distinct 
processes are defined, . but it should be recognized that in practice, the 
point at which one, process stops and another starts is somewhat arbitrary. 
The boundaries between the processes as given here are aids in understanding 
the processes (fundamental elements) and represent a useful way of organizing 
them for application. 

3. Sample Formats 

Format differences were found to be preferred v/ays of displaying 
the results of the processes. The formats given as samples in the 
specification (Task 5) are adaptations of those used to present the 
results of the analytic processes in the effective studies, Others may 
be found to be useful at some future time, but an ^integrated set of 
formats 5 based on those that have been found effective, are prescribed 
here and in Task 5 (Specification), 



C , Approach - Specific 

1 ; A nalysis of Exi sting Data in Terms of Fundamental Elements 

The following is a list of the fundamental elements generated in 
Task 2, which was th-e starting point for Task 3: 

(a) Content Analysis. 

(1) Equipment Analysis 

(2) Functional Analysis 

(3) Task Analysis 

(4) Behavioral Analysis 
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i b) PiTiJcedu^'es 



(1) Serial Procedures 
(2j Branching Pt^ocediires 

(c) Functional Understanding 
( 1 ) Traini rig 

^ (2) Narrative 
(3) Graphics 

(d) Intell igihility 

(1 ) Simpl ified Text 

(2) Text Gr^aphic Combinations 

(3) Organized Formats to Support riulti-User Performance 

(e) Motivational Graphics 

(1) Motivation Graphics 

(2 ) Personal Involvement 

(3) Color Graphics . , . ' 

Each nev/ concept was descrihed in terms of the fundamental elements 
which were fully developed in the cDncept^ and thor.e which achieved moderate 
development. However, the process of doing this led to the drawing up of 
a simplified set fundamental elements, and to the recognition that every 
concept included something of each element. When independent judges attempted 
to describe each concept in terhis of the eTements listed^ each found It 
difficult to decide whether a concept used a Q^ven element or not. After 
they had done their job, they discussed their ditricultles together and 
came to the realization that it was not a case Of have or have not, but a 
question of degrees of having each element. 

The Task 2 list also has Functional Understandlrtg as an element, with 
Training, Narrative, and Graphics as means for achieving it. However, 
Functional Understanding Is an objective of Functional Analysis, and not a 
process in itself, and was dropped from the list. Procedures are a product 
of a process like Behavioral Task Analysis and not a process In themselves. 
So they also were dropped from the list* The original element Training was 
deleted as well: training is a medium for delivering Information, 'not a 
process for generating the Information needed for understanding. Similarly, 
Narrative and Graphics are means or media for the delivery of information, 
and not processes for generating it. All of these were rejected as funda- 
mental elements, . 
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Intpniqibility, nsxt on the list, was retained as a fundamental 

i^tir of information. It depends on the charac^-en sticb oi Uia use . In 
he present study, the user on whom most of the costs of ownership hinges s 

novice Certain of the new concepts used processes for making ^nforniation 
intelligible to novices. These processes are fundamental elements, and have 
b..n q.ven th^= name Intell iqibi li ty Standards. This then, ^^the fifth 
fundamental element. It is^used in conjunction with the four types of 
analvnc crocesses. It consirts of two parts, text and graphics. Text . 
i.'used to convey infomation about action (verbs). Graphics are used 
pHmarilv to convey information about things (nouns). Organized formats - 
for supooi'tinq multi=user formats are not included as a fundamental 
element, but the format prescribed 1s organized for multi-users. 

One last element, Motivational Graphics, appears on the Task 2 list. 
Motivational Graphirs is recognized to represent processes Tor improving^ 
pprformanne, and the Armv Materiel Conmand has been the leader in al i the 
services in'using these processes. However, there has been no reseat^h 
foil nw -up. Without results there is no way to project costs. Por tnis 
reasnn. Motivational Graphics is not included as a fundamental element. 
Soweve^, there ha^ been ood acceptability from the fie d on manuals for ■ 
organuational personnel which have similarities to motivational graphics 
manuals. These manbals use color, simplified graphics, gi^aphics and 
instructions on the same page and somewhat simplified "O^^s and have been 
produced without specifications by the Armament Command. The Processes 
for producing tham sound very much like the processes for the other new 
concept manuals, but without data and without specifications it is 
impossible to go beyond what is said here about this type of manual. 

Even though Motivational Graphics and Its sub-groups are not considered 
fundamental elements, the use of color should certainly be considered for 
orqanizational manuals. No requirement for color hasbeen positively 
identified, but it is not precluded by the specification produced under 
. the present contract. 

The final list of fundamental elements accepted for purposes of 
conducting evaluations is as follows: 

0 Equipment Analysis 

0 Functional Analysis 

0 Task Analysis 

0 Behavioral Task Analysis 

0 IntelligiblHty 

It was in terms of this list that the new concepts were investigated. 
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In evaluating th.e data it was found tiict the aiinensions alona A^^nirh 
invpstigators have collected data in this field incTudB: 

0 Tfie mmber of items conipletod oor unit ziuiQ 

0 Tdia time to coniplete unit items 

0 The time to train 

Q The skill level of the personnel pool beinu tapped - , 

0 The number of parts erroneously replaced 

0 Accuracy 

0 User endorsenient 

0 Differences in school attrition rates 

0 "Within tolerance" performance rates 

These results are not directly trans^latabl e into costs of ownership. 
Therefore, it v^as necessary to select those that would directly translate 
in factors that are known to be the major contributors to cost of ownership. 
To .do this the results were reduced to: 

a . Reduction s, in Training Time 

The data on time to train translates directly into reductions 1n 
training time. Some results are reported in terms of school attrition 
rates. While such reductions certainly affect time to train, the trans- 
lation factor is difficult to project, and, therefore, results reported in 
terms of reductions in attrition can only be considered supportive of 
results reported in terms of time to train. If they could be figured in, 
it would increase whatever values are reported in terms of reduced training 
time- In certain studies personnel perform with a new concept TM, or 
general tasks like using torque wrenches and safety wiring. Such study 
results are recorded as "approaching 100%'- reduction in training time/ 
They are characteristic of non-troubleshooting tasks ^ not troubleshooting. 

b ' Reductio ns _ in_W Qr^ Force 

The number of items completed per unit time translates easily into 
work force. If one man can produce twice as many items per unit time 
using a new concept TM, then a work force reduction of BOX can produce an equal 
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n\.::vb-r of itms in thn unit time. It 1s reconnized that work force 
reciiictlons can involve other factors than speed of production. For 
instance, if' fewer men are placeH in the v/ork force, one may have to 
M,ivn pMjitiple skills that we?^^i p^^eviously inherent in the complete v/ork 
force. There is evidence that the new concepts result in good transfer 
from one job specialty (MOS)^ to another, but it would be exceedingly 
difficult^to translate this into specifics across all Army situations. 
Ir is much GJdsier to make a conservative estimate on what reduction in 
work force would be possible, for instance, to project a reduction of 
15^ instead of 50^^ for the results used in the evample above, 

Reductions in Fal se Removal 

The number of parts erroneously replaced translates directly to 
:*-Fal:.e removals''. In contrast, other measures such as "accuracy" and 
^^errors" do not translate directly. The definition of an error is not 
that the individual makes an error in what is removed; it refers rather 
to what the eKperimenter defines as an error. The term error mighty 
refer to a false step that the individual user corrected himself; it might 
mean an inefficiency that an alternative series of steps would have 
completed the same job more rapidly or it might mean a false removal. 
In the first two cases, more time than necessary wouTd have been taken 
to complete the job. Some experimenters record only "errors'- and not the 
time required to complete the job. This does not translate into data 
useful for cost projections. Recording in terms of "accuracy" has the 
same deficiencies as recording in terms of "errors". It 1s dependent on 
the experimenter's judgement of what is accurate, and it does not trans- 
late into time or any other data form that is useful for cost projections. 
Without knowing how long the work took or how many items were completed 
per unit time, "accuracy" means nothing. It might take twice as long to 
be accurate. The data on errors is supportive of data on parts erroneously 
replaced, but it is not used directly in the estimate of false removals. 

The results obtained with various concepts and the fundamental elements 
to which the results were attributable are contained in Table 1, 

3, Discussion of Results of Data Reduction 

Data on troubleshooting performance have been collected and reported 
for seventeen instances of implementation* The fundamental element of 
Functional Analysis has been fully developed for troubleshooting tasks, 
primarily electronic, but also mechanical and hydraulic. Concepts which 
developed Functional Understanding through trainfng and block diagrams 
have been demonstrated to be effective for troubleshooting. Procedure- 
oriented concepts have not been demonstrated to be effective for trouble- 
shooting, except for some "error" reductions, which are largely a matter 
of the experimenter's definitions. 
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Rcri ul of Conccip 



con ceo i: 



FORECAST 
1958 - 
Armv Radar 



rully 

Developed 
Fundamental 
i-lleraencs 



Functional 
Analysis 



Elements 
Moderately 
De ve loped 



Equipment 
Analysis 

Intelligi- 
bility 

Task Ana.lvffis 



L asK 



NTS/ 
TS* 



OBJECTIVES 

Reduced More 
Traigin g Work 



50% 



Fewer 
Errors 



FORECAST 
1959 - 
Army Radar 



FORECAST 
1963-1964 
Navy Loran 



Functional 
Analysis 



Functional 
Analys is 



Equipment 
Analysis- 

Intelligi- 
bility" 

Task Analysts 



Equipment 
Analys is 

Intelligi- 
bility 

Task Arialysis 



TS 



TS 



50% 



40% 



JOBTRAIN 
1962 - 
Army 

GoTTiiTi un i c a t i o n 
Equipment 



MA INTRA IN 
1963 - 
NIKE 



riAXnTRAXN 
1H4 - 



,pment 
Analysis 
Functional 

Anaiysis 
Task Analysis 



T^ 



Functional 
Analysis 



TS 



Functional 
Analys is 



30 



TS 



50% 



40% 



MTS ^ Non-troubleshootinc 
TS - Troubleshooting 



41% 



EKLC 
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RGsults o£ Concepta 



Lance 



SIMS 
1964 



MDS 
AVIS 
1964 - 
Radar 



BFIC 
1966 



Fully 

Procedur-- 

aliaed Aids 

JPA 

1968 



PIMO 
1968 - 
C141A 



BRITISH 2" 
ALGORITHM 
1969 * 



Fully 
Develcped 
Fun damental 
Elernents 



B unc tional 
Analysis 



Task 
Analysis 



OBjECTIVES 



Elements 
Moderately 
Developed 



Task 



T5 



Reduced 
Training 



More 
WorP 



Errors 



MDC* lowered 
intelligi^ 
bility for 
novices 

*Ma In tenance Dependency_Ch_art_ 



Functional 
Analysis 

Intelligi^ 
bility 



Functional TS 

Analysis 
Equipnient 

Analysis 
Task Analysis 



Functional TS Almos t 

Analysis 100% 
Task. Analysis 



Intelllgi- ^^TS 
bility 



24% 



23% 



Functional 
Analysis 



200% 



11% 



200% 



80% 



'no valid coniparison to performance of another group. No measure of 
effect i vene s s , 

^Reported in other secondary sources but not confirmed in primary sources 
(only 5 sufajects) . 
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results OL Concents 



ConceDt 



FEFI/TAFI 
1969 



JPA - 
Non=TS 
19 70 - 



Fully 
Developed 
Fundament: a 1 
Elemencs 



Task Analysis 
Intelligi- 
bility 



Elements 
Moderately 
Developed 



Functional 
Analysis 

Intelligi- 
bility" 



Task 



TS 



NTS 



objective: 



Reduced 
Train inj-^ 



More 



0 



100% 



314% 



30% 



Errors^ 



S1K\S 
1971 - 
SRC-20 
Radio 



Functional 
Analys is 



TS 



Pos itive 



JPA 1 2 
19 71 & MDC 
UHIH 



SMD 



MDS 

1972 - 

Radar 

Senerator 



iipment 
Analysis 
Task Analysis 
Behavioral 

Task Analysis 
Intelligi-" 
bility 



Functional 
Analys is 



Almost 
NTS/ 100% 
TS 



TS 



NTS/ 
TS 



60% 



Neeative 0 



JPA x^as revised by Behavioral Task Analysis and Functional Analysis before 
results reported xmrm obtained. Without revisions there was- no difference 
in ner formance . 
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Personnel could not use MDC and could not 
time . 
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Rep tilts of concepts 



Con CCD t: 

J PA 
1972 - 
Power Plant 



Fuliv 
Do 'J a lon'^cl 
Funaamcincal 
Elements 



Elenitin 
Moderately 

_Develq ped 



Functional 
Analysis 



Task 



IsTS 



Reduced Moro 
Tr_aining Work 



Large 



Less 



r ewer 
Errcr: 



MBC 
1973 



Lowered 
Intelligi- 
bility for 
Novice use 



-20' 



1973 



TS 



More 
Training 



.30' 



0 



-1 

Manual had to be re'^ased for test to be conducted. 



The effectiveness of procedural 1 zed troubleshooting has not been 
demonstrated in the new concepts analyzed in this study J It has been 
demonstrated that troubleshooting can be procedural ized. And it has been 
demonstrated that some people can follow troubleshooting procedures. But 
the efficiency of personnel using fully procedural ized troubleshooting 
procedures has not been demonstrated except for very short sequences. A 
procedure is inherently inefficient for troubleshooting because it prevents 
the user from skipping time consuming steps while remembering that they 
must be returned to if necessary. An equally serious source of Ineffi- 
ciency is that a user who misinterprets a reading and takes the wrong path 
in a procedure has no way of returning to that point after he finds he 
is on the wrong path. He must return to the beginning of the procedure 
and repeat many steps that were originally performed correctly. 

On the other hand the increased effectiveness of block diagram 
approaches to troubleshooting have been demonstrated several times* When - 
this approach has been used in new concepts the results have been increases 
in troubleshooting effectiveness up to 200% (FORECAST, 1963-19645 see 
Table 1). The functional analysis for the block diagram approach is 
therefore selected as the fundamental element in this study* 

It should be noted that within the block diagram approach some^ pro- * 
cedures are used/ These are procedures for making measurements. They are 
produced by the Behavioral Task Analysis and incorporated in the block 
diagram troubleshooting produced by. functional analysis, 

- In the case of "understanding" implementations, only those using the 
MDC failed to meet with success in all cases when used by novice personnel. 
This is somewhat surprising, in that the MDC presents exactly the same 
information as the block diagram used to support understanding, and the 
block diagram implementations were uniformly successful- But the MDC is 
a cryptic, abbreviated presentation, whereas block diagrams are coniTion use 
in our cultiire. The MDC must be learned as a new language. This charac- 
teristic forces the treatment of MDCs as a special case* If the MDC 
ifnplementations are omitted, increase in productivity associated with 
understanding ranges up to approximately 200%, Training reductions for 
troubleshooting tasks range up to 60%. 

Procedural implenientations have been used extensively on non-trouble- 
shooting task&i They have produced good results. Task Analysis has been 
used to identify detailed task steps. The results have been good in tests 
of the PIMQ concept, 3 When the same processes were followed for generating 
the JPA manuals, there was no improvement in performance until a Behavioral 
Task Analysis was performed, and the JPA was revised according to this 
analysis. 
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34 : 



The median increase in performance associated with .procedure-oriented 
concepts in non-troubleshooting tasks ranges up to 60%, and training 
reductions approach 100% in studies using these procedures. 

= 4. Evaluation of Conce pts Lacking Ex perimen tal Data 

The concepts with data were compared with, the concepts without 
data. The fundamental elements were not well developed in the published 
material on the concepts without data, but it was relatively easy to 
Identify similarities between the fundamental elements of the concepts 
that were well developed, and those that were not. It 1s believed that^ 
any new concepts which might appear In the future can be compared In a 
similar fashion. Appendix B contains descriptions of each of the concepts 
that had no data. Their similarities to other concepts, and certain 
unique features, are also discussed here, 

5. Results in -Terms of Projection- of Xosts . ^ . . 

a. Training Time Reduction 

(1) Non-Troubleshooting Tasks . Training time for non-ttouble- 
shooting tasks has been: reduced to a near zero level In some research 
studies. /Personnel with virtually no training have performed as well as 
personnel with sixteen weeks of training* Manuals produced with the funda- 
mental elements of Equipment Analysis, Task Analysis, Behavioral Task 
Analysis and Intelligibility Standards havj made that difference. A 
figure of 95% reduction in training is used for the cost projection. 

(2) Troubleshooting Tasks . Training time has been reduced as 
much as 60% for troubTeshootIng tasks with performance remaining equal. 
The content of the reduced training was entirely different from that in^ 
the longer training. The content was functional infonnati on presented 1n 
special manuals, and rehearsed during the training. The fundamental 
elements used to produce these results were Equipment Analysis, Functional 
Analysis and moderately developed forms of Task Analysis, Behavioral Task 
Analysis and Intelliglbnity SMndards, 

(3) A figure of 75% reduction In training is used as an 
average for troubleshooting and non-troubleshooting tasks. This is carried 
forward to the cost projection made in Task 4. 

b. Reduction in Work Force 

Increases in performance levels reported in these studies have 
ranged to as high as 200%, |Th1s means that personnel with new concept 
manuals and training have correctly performed as much as three times as 
many tasks per unit time asj personnel using conventional TMs and training. 
This would indicate that asl much work can be done by one-third as many 
people, a 66% reduction in -work force. There are many factors which affect 
work force size other than|th1s one. Some are discussed in Appendix C.^ 
For the purposes of the cost projection, a conservative figure of a 15% 
reduction in work force Is, used. 
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False Removals 



The number of false removals 1s difficult to estimate from 
results reported in terms of errors". Only a fraction of errors made are 
actuany fals-e removals.. However, from the results given, a figure o + 
15 reduction in false removals is a conservative estimate. 

D. Summary 

The folliowing estimates from results obtained with the new concepts are 
carried .forward to the cost projections made in Task 4, These areXthe 
estimates of reductions which would prevail if the fully developed form 
of each ofthe fundamental elements were to be used in one inteqrated\ 
concept. The specification developed in Task 5 includes the fully developed 
form of all the processes for production of a Job Perforinance Manual (see 
Task 5, paragraph Al ) . - 

0 Reduction in Training - 75'! ' , 

0 Reduction in Work Force - 15;^ 

0 Reduction in False Reinovals - 15-^ 
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TASK 4 



Introduction 

= This sectit^n describes activities coiTipleted under Task 4: Evaluation of 
Approaches by Commodity Systems and Cost of Ownership Projections* The 
activities performed during this task were: 

0 To collect information on the Comodi.ty Systems. 

0 To review the fundamental elements from Task 3 against this Informa- 
tion in order to confirm that they apply to all Conmodity Systems 
and to detect situations in which the fundamental elements would not 
be appropriate. 

0 To examine the TM specifications for Commodity Systems in order to 
identify conflicts with the fundamental elements. 

0 To identify the cost elements of each of the three changes in the 
personnel subsystem identified in Task 3 and to project the change 
in cost of ownership which could accrue through use of the funda- 
mental .elements to produce all Army TMs. ^ 

Information on Commodity Systems was collected through field trips and a 
review of available literature. 

The fundamental elements identified in Task 3 were reviewed for their 
appropriateness in the various Commodity Systems. The basicaTly different 
situations were Identified in Task 3? Troubleshooting and Non-troubleshooting 
Tasks. The fundamental elements for the items are the same except that 
Functional Analysis is performed only for troubleshooting tasks. The 
question addressed in Task 4 was whether .the five fundamental elefjients 
were sufficient fpr treating situations and environinents in all Commodity 
Systems, or whether some systems required new elements or variations to 
tredt some unique situation. 

The TM specifications of each Commodity System were examined to see if 
any of the fundamental elements would be in conflict with them. 

The costing objective of this task was to collect data on costs of 
ownership that are affected by the results brought forward from Task 3, 
and to project reductions in cost of ownership across all Army systems. 

The primary source of data on cost was the Comptroller of the Army 
and the Military Occupational Specialty Training Cost Handbook^ (MQSB) 
1n particular, - 

The primary source of data on numbers of personnel in maintenance 
categories in the Army was the Department of Commerce Statistics* 



Published by the Directorate of Cost Analysis, Office of the Comptroller 
of the Army, Washington, D. 20310, May 1974. 
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Results 



1. Conmrodity Systms Cha racteristics 

In order to evaluate tN rMpoftslveness of the hypotheses developed 
1n Task 3 to the various -COTmodlty SystCTS, 1t was necessary to examine ' 
'the operational and maintenance en^iromnents of each Conmodity System. 
This was accomplished through visits to several operational facilities, 
interviews with Army personnel In tte respoftsi ble, ^commands » reviews of 
current reports, and a review of the ttri^wt techhical TOifiyal specifications 
covering the various Coniftodlty Syst^^* The ComFTOdity Systems covered 
are as follows: 





COffiODITY SYSTEM 




COMMAND 


a . 


Aircraft 




Aviation System: 


b. 


Communications 




Electronics 


c . 


Missiles 




Missile 


d. 


Munitions 




Armament 


e. 


Iteapons 




Armament 


f . 


Vehicles 




Tank-Automotive 


9' 


Support Commodity System 




Troop Support 



Each Commodity System was reviewed to tdentify personnel skill levels, equip 
ment types and complexity ^ and maintenance facility fequlreTTients. 

Technical Manual specifications reviewed for the various Conmodity 
Systems are listed in Appendix D., Each specification was reviewed for 
organization requirements, theory requ,iren»nts, troubleshooting task 
requirements, non-troubleshooting task r^ulrements, text and diagram 
format requirements, and quality assurtnce requirements. This examina- 
tion was performed to Identify the to which requirerents were 
established in each of these arms, antf-tffmreiTCes in these requirements 
across conmodity types. 

a. Aircraft CcwBrodlty Systm 

The Aircraft Comf^ity System is administered by the U. S. 
Army Aviation Systems Cormwind (AVSCGI4), 

With respect to maintenance manuals, AVSCOM Is responsible for 
maintenance engineering, stock atid supply control* and technical assis- 
tance to users of all Army aviation and aeritl delivery equipment. 

Equipments include end Item aircraft ^ airframe structural components^ 
ground support equipment, wheel And brake systems, gas turbine engines, 
jet engines, internal COTibustion, radial and horizontally opposed air- 
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craft engines, parachutes and parachute accessories hydraul ic pumps, 
starters, etc. . 

Enlisted personnel maintaining aircraft commodity iqui'pment fall 
generally under the following MOD series: 

67 Series - Aircraft Maintenance 

68 Series -Aircraft Components Repair 

Army aircraft are large, complex, diverse systems. A complete aircraft 
normally consists of several independent systems, such as the airfame, 
navigation equipment, cotimuni cations equipment* armament, power plant, etc. 
Within some of these systems there are very diverse equipment types and 
complexities. Without precise documentation, it takes a wide range of 
specialties to maintain an aircraft. At present there are 27 MOS positions 
for aircraft maintenance. In addition, multiple levels of maintenance are 
used to ensure short down-times. For example, a defective assembly or_even 
entire equipments will be removed and replaced so that the aircraft will 
be quickly returned to operation. The assembly or equipment is then 
repaired off-line. Aircraft are designed with this process in mind, 
probably more than any other type of equipment. Once the assembly or 
equipment is removed from the aircraft, hov«ver, Its maintenance character- 
istics are basicafly the same as those for other Comodity Systems. 
Thus, the critical difference between aircraft systems and other systems 
is at the first level of maintenance, which is designed to return the 
aircraft to service quickly. This also inclu*s preventive maintenance, 
checkout, and scheduled maintenance. 

' FinsUy, aireraft require very diverse spa.ces provisioning and tools. 

b. Cnmrnuni ca tions Commodity System 

The Communications Conmodity System is administered by the 
U. S. Army Electronics Command (ECOM). 

ECOM is responsible for maintenance support and supply of communication 
and electronic equipment and systems. 

Enlisted personnel maintaining communications' conmodity equipment 
tend to fall under the follpwing MOS series: 

• Radar and Microwave Maintenance 

- Field Communications Equipment Maintenance 

- Fixed Plant Coirniuni cations Equipment Maintenance 

- Intercept Equipment Maintenance 

- Data Processing Equipment Maintenance 
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Commum cations systans are electronic/electro-mechanical In nature. 
Electromc equipment design has had a marked effect on electronic main- 
tenance phnosophy. With^the advent of semi-conductors and micro- 
ffiiniaturization, equipment packaging became rTore modularized and some- 
times more functional. This created the potential for sifTlplification 
of troybleshooting and repair of these equipments, but in practice it 
has not consistently led to simplification. The modules are seldoni 
designed functionally from the troublestiootlng point of view' Usuallv.^ 
many different signal paths trace through one. module so that although^ 
modularization reduces the number of Items of. spares required for a given 
equipment, the overall effect is to increase the cost of each spare item. 
Furthermore, modules tend to be unique for given equipments. For 
instance, when an entire high cost "deck" of integr/ated .circuits is 
the replaceable unit, the low cost 1/4 watt 1000 ohm resistor , which 
may be common to many systems, is no longer an item of replacement. 

Tools arid test equipment requirements are not especiany diverse 
nor extensiye in electronic equipment. Test equipment is typically 
common to all equipment, with^ special test equipment required only for 
equipment operating at very high and ultra-high frequencies. However, 
there are often different models of the same basic test equipment, -e.q. , 
different! oscil loscope and multimeter models. The need for the 
e>:tensive varieties of the same basic instruments is questionable. 

The maintenance environment at the organizational level ranges 
from primitive field situations to shop environinents . Upper level 
maintenance occurs in environmentally protected shop-type work areas. 

All levels of maintenance use technical manuals to approximately 
the same degree. 

- c. Missile Commodity System . 

The Missile Commodity System is administered by the U. S. 
Army Missile Cormiand (MI COM). 

MICOM Is responsible for the maintenance, with technical manuals, 
of rocket, missile, and related programs. 

Equipments include free rockets, guided missiles, ballistic missiles* 
target missiles, aij defense fire coordination equipment, special purpose 
and multi-system test equipment, missile launching and ground support 
equipment, and missile-fire control equipment . 
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Enlisted personnel niGintaining rnivnle coimiodlty equipment and systems 
tend to fall under the foil owing. MOS series: 

21 Series - Ballistu nisrnle Electronic Maintenance 

22 Series - Guided Missile Electronic Maintenance 

23 Series - Missile Fire, Control Electronic Maintenance 

24 Series. - Air Defense Missile Electronics Maintenance 

26 Series - Missile Mechanical Maintenance 

. Missiles are similar to communications systems in that both are highly _ 
electronic/electro-me^chanical 5 mth modular packaging of newer equipment. 
Maintenance tasks include a lot of inspection and checkout. ^Troubleshooting 
occurs in the- event of an inspection or checkout failures or report from 
operators. Test and checkout equipment tends to be unique for each 
missile, except for thf^. cornmon test equipment , e.g.^ oscinoscopes and 
multimeters that come in various models. Some 42 MOS positions are used 
rn thi s system. ■ ? . 

/ i ■ . 

^ Troubleshooting and repair tasks are performed at the higher echelons 
of maintenance, usually in shops and laboratories for test Instrument 
calibration. Spares provisioning tends to be unique for each misSile 
type- All levels of maintenance use technical manuals to approxiriiately the 
same degree. j ; 

/ 

d. Munitions Commodity System / 

i 

The Munitions Commodity System is administered by the U. S. 
Army Armament Command (ARMCOM). / * 

ARMCOM is responsible for technical manuals for nuclear and non-nuclear 
munitions, including rocket and missile warhead sections^ demolition 
munitions, and offensive and^ defensive chemical material. 

Typical items include grenades , mine's ^ warheadSg explosivesi smoke 
generators, chemical irritantSs and incendiary units. 

Munitions are maintained by the^-fol lowing MOS series: 

54 Series - Chemical / 

55. Series - Ammunition 

Munition^ maintenance is unique in that virtually no maintenance is 
'performed at the organizational level except specific storage and 
inspection tasks. Direct support ma|intenance adds only the cleaning, 
repackaging, and replacement of external components. Gene'ral support 
extends to internal repair. Thus, there is a very fixed division of 
activities. The variety of skills minimal. Only 5 MOS positions are 
required. Because of the extreme dangers involved, manua/ls are used 
extensively even by exRerienced pet/sonnel . The maintenance environment 
at the organizational level is the/storage facility. At/direct support/ 
general support level the inaintinafice environment tends /to be an elaborate 
shop/laboratory facili ty. ■ ^ I : 



e . .. Weapons Cormiodity System 



Like the Munitions System, the Weapons Commodity Systeni is 
also administered by ARMCOM. (ARMCOM was formed in 1973 by merging" two 
major subordinate commands - Munitions and Weapons,) 

ARMCOM is responsible for technical manuals for all nuclear and non- 
nuclear ^'vfe^ons , incl uding artillery, Infantry, gun-type air defense, 
and surfacev^hicle mounted and aircraft mounted weapons. 

Equipments Include artillery and infantry weapons and weapons systems^ 
tanks and tank-like vehicles, small armSs arfnament for Army aircraft, 
and fire control equipment for these wapons' systems . 

Enlisted personnel maintaining Weapons Commodity equipment tend to 
fall under the 45 MOS Series: Armament Maintenance. ' 

Weapons are largely mechanical and electromechanical in nature; Failures 
normally occur as a result of Improper care or routine wearout. Mainten- 
ance Is largely preventive: replaceirent of worn parts, and overhaul. _ 
Preventive maintenance is performed at the operator level. Organizational 
maintenance ts largely limited to replacerent of parts that can be 
accomplished in a field environment* Direct support and general support 
maintenance is perfornied in both field and shop environments, often using 
powered tools and holding fixtures. Overhaul , of course, occurs at the 
depot level. The variety of skill leveT requirements is minimal, as only 
5 MOS positions are require in weapafis TOintenance. All echelons use 
technical manuals to about-the same defree; use tends to decrease with 
increased experience on a particular i^apon. 

f , Vehicle Comrodlty System 

The Vehicle Commodity System is administered by the U. S. Army 
Tank-Automotive Corrfnand (TACOM). 

TACOM is responsible for technical nrianuals for tank-automotive material 
throughout the entire U. S. Armed Forces, 

Equipments include combat and tactical vehicles, motorcycles, motor 
scooters, trucks, trailers, their accessories and components. 

Enlisted personnel are primarily in the 63 MOS Series: Mechanical 
Maintenance. 

Vehicles systems maintenance is like aircraft maintenance. Many 
components are replaced on-line, in order to return the vehicle rapidly 
to service, and then repaired off-line. This is particularly true for 
Combat vehicles that include sophisticated armament systems. It is these' 
armament systems which make the combat vehicles much Ifke the aircraft in 
maintenance characteristics. The variety of different sub-systems on 
combat vehicles is less, however, as there are only 8 MOS positions- Four 
of these are associated with tank turret maintenance (45 MOS Series), ihe 
rest relate to wheeled and tracked vehicle maintenance, Thus^ when compared 
with airrraft maintenance, the variety of skill requirements is small, 
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In terms of spares provisioMng and maintenance support also, vehicle 
maintenance is similar to' aircraft, but without the extreme variety. 



g.' Sij p pnr t Commod i t v S.y s tem ■ \ 

The support commodity systems are> administered by the U. S. Army 
Troop Support Cammand (TROSCOM),, \ 

TROSCOM is responsible for such items as ^rrlers and bridges; water 
purification equipment; rail, marine, and amph|b1ous equipment; power 
qenerators; materials and food handling equipment; industrial engines and 
turbines; and environmental control equipment. Material s^handling equi p= 
ment which are presently under TROSCOM will be .transferred to TACOM 
1 July 1975. 



Enlisfed personnel tend to fall under the following MOS series- 
52 Series - Power Production and Distribution 

61 Series - Marine Operations 

62 Series - Engineer Heavy Equipment Operation and Maintenance 

65 Series - Railway Maintenance and Operations 

Support systems are a conglomeration of the equipment necessary to 
support troop activities. Maintenance requirements of this diverse group 
equipments are similar to those of one or more of the other cormodity 
systems Skill level- requirements are also diverse. -Approximately 10 
MOSS are associated with support maintenance, with less than Spositions 
in any one category. Tools , test equipment, and facility requirements 
run the gamut- The equipment is often coiniiercial , for which commercial 
manuals are used or adapted. Noh-troubleshoottng maintenance tends to 
predominate in this system and inspection plays an important role as it 
does in munitions systems. This Importance of inspection impliesan 
emphasis on graphic support, because graphics are the primary basis for 
distinguishing visual cues. Words are more useful for stating the action 
that should be taken after the visual discrimination is made. 

h. Depot Level Operations 

A visit to the Corpus Christi Depot made it clear that the 
fundamental elements of the new concepts would not apply easily to depot 
operation, because so much fabrication Is done there that is not amenable 
to standard procedures described in a manual. The assembly processes are 
■amenable, but they are generally performed by personnel with years of 
experience. This is described and discussed in Appendix E. But for the 
purposes of this study, depot level maintenance is excluded. 
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2 * Concegt Jundamental Elements Reviewed Aga inst CQmrnQdity Systems 

In Task 3, five fundamental elements w^re identified as the Drocr-n?«s 



for producing a nianual. Slightly different combinations were irientifie 
t^^oubleshooting and non-troubleshooti nd situations: 



^or 



Pngcgsse s Rec jAjjj:ed 

Troubles hooting - ' Nonjjj^ u M es]K) i n g 

Equipment Analysis Equipnient Analysis 
Functional Analysis 

Task Analysis ' Task Analysis 

Behavioral Task Analysis _ Behavioral Task Analysis 

Intelligibility Intelligibility 

Once the maintenance characteristics of the commodity systems (Aircraft, 
Corrimuni cations , Missiles, Weapons, Vehicles, Munitions, Support) had been 
defined, the effects of those characteristics on the processes for genera- 
ting a manual were examined. The examination was made in terms of which 
environments or situations in a commodity system would not be amenable to 
any one of the five processes (fundamental elements), 

3^ Analysis of the Maintenance Situations ' ^ 

a. Maijitenance Mission ^ ^ 

The maintenance missions are constant throughout the commodity 
types. Preventive maintenance is performed only at the operator/organizational 
level with the remaining activities being performed across all of the echelons. 
As defined in Task 3, the maintenance missions are still categorized under 
either troubleshooting tasks or non-troubleshooting tasks. 

Troubles hooting Tasks Non-TroubleshootinQ Tasks 

Malfunction Diagnosis Preventive Maintenance 

and Isolation 

RepTacement 

Repair 

Overhaul 
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>-ithouqh r<HD IfliCpnient and/or repnir iabk& are r^equired to complete a 
trMiibleshootinq nayk, they may also be perfor'med as a result of an inspec- 

-'n. Thu?. '.hey i\ro ronsidereH non-troubleshooting tasks. Troubleshooting., 
d;. \^^?C her^i, Jei^cribes those actions necessary, to locate a faulty component 
oncii a :nr 1 funrtion symptom has teen detected. All commodity systems have 
-uth kindr of to^^---. 

S^- O'VTiniod 1 1 y i hft jer ii_t jcs . ' ^ ^ 

A daran-^'a discussion of the commodity characteristics 1s provided _ 
in oaraqrapf^ B ot thil Task description. In terms of the commodity break- 
down (^lec;:r1cal/e1ectronic, mechanical, fluid/air flow; and simple versus 
complGx), each commodity type can stUl be characterized as being made up 
of one or mre of these equipment types. This has little effect on the 
procab:: for preparing documentation. The content specifics differ, but the 
proc^-,— IS for preparing the specifics are the same. It was noted that as 
d n/:t:fMii becomes more complex, the maintenance mission tasks are spread 
across the echelons of maintenance and MOSs. This requires that the infor- 
mation be packaged and indexed accordingly. It does not affect the process 
of .preparinq information for each echelon or each MOS specialty. 

c, Ski]}_l§yeX • ' ' 

The skill level for a job 1s usually defined in terms of the. 
amount of training required. Skill levels are sometimes defined in terms 
of fineness of discriminations, deKterity, etc. Th^'re are also subtle 
distinctions made in tertTiinology, e.g., repairman, technician, maintenance 
personnel, etc. There are also some distinctions made in terms of aptitude. 
The higher the echelon, the more highly skilled the incumbents consider 
themselves to be. o 

Ttie process for producing a manual should describe each task so that 
personnel of grade school reading ability can follow the 'instructions 
and perform the task. There are no assumptions about the skin level 
required to do this. For the higher echelon personnel there will be more 
tesks to be performed within an MOS. and this variety may be considered a 
matter of skill, but to follow the instructions for any Individual given 
task, no special skill is assumed. 

Experienced personnel may be regarded as more hfghly skilled in the sense 
that they have memorized many of ^the steps which constitute a task. They 
often can perform a task faster. Experienced personnel know "short cuts" 
and this may be regarded as higher skill, but none of this affects the 
processes for producing manuals for the nov1ce= The analyst who prepares 
the task step "details Identifies the shortest set of steps for getting the 
task done properly, the process results in detailed instructions (graphic 
and written) for the novice user on how to perform each task within a job. 
Skill Increases as personnel continue to use the manual, but there are no 
difforential skill requirements for using it^ ''Complex*' tasks will result 
in more pages of description than a ''simple" task. But page for page the 
complexity will be the same. Experienced personnel who have learned many of 
the procedures in the manual can skip over those details of how to accomplish 
the instriiction, but the details will be generated by the fundamental 
processes and will be Included in the manual. 
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d. Maintenance Environment 



The extent to which tools, test equipment and facmtles are 
available in the maintenance environment is a function of the level of 
maintenance. The length and support requirenients of various tasks and 
the allocation of spares at the various levels of maintenance are factors 
which determine the maintenance environment. The higher the echelon, the 
greater the support provided in tems of tools, test equipment, facilities, 
processes, etc. Since tools and test equlpnwnt are used 1n task perform- 
mance, instructions on how to use them are given in the manual. The 
specifics of the instructions will be different for each tool, but the 
process for generating the instructions remains' the same for all. With 
more tools, more instructions are needed. Increases in special tools 
and equipment indicate that more of the Instructions for their use should 
be taken out of the main body of the manual, and placed in off-line 
training (see Task 5). This is done to avoid repetition In the manual, 
but it does not affect the processes for prepartng the step-by-step 
instructions. The processes for generating content going 1n the manual 
and in training are the sane. 

4. Review of Ex j sting Specifications 

In an additional attempt to'dlswfer.any differences required in the 
process for producing docurrentatlotT far tim nerfom Conmodlty Systems, 
sixteen technical manuals speclflcatTtins were reviewed. The specifications 
covered all of the conrnodity types retjutred under this contract. Each ' 
specification covered at least the orfan1rat1ofTBl , direct support, and 
general support levels of maintenance. 

The technical manual speclficatrfOTW.-eftwfcefcWdl across the corTmodlty systems 
revealed the following differences and sfrnfTaHtles: 

a. The most detailed requirements were contained in the specifica- 
tions for electronic equipment and for aircraft and aircraft equipment. 

b. Content organization requirefnents were basically the same for _ 
each conmodity type with aircraft requirements being the most specific. 
Here specific subsystem headings were called out and coverage for each 

subsystem detailed. 

c. All specifications called for "theory".' Only four spetif ications , 
those for telecoinnuni cation equipnent, tele typewriter equipment, electronic 
configurations for aircraft, and photographic equipment, required theory in 
detail. Of these four, only the specffi cations covering electronic equipment 
maintenance were explicit by calling for theory "to' the point of explaining 
each circuit". So, though these specifications are different, none of them 

1'=, siifficipntly explicit to make much of a difference in what the TM 
Dfoducers do. 'in fact, what the producers do Is determined more by what is 
"traditionany done" (i.e., by examples from previous TMs that were acceptable), 
than by the specif ications themselves. 

5:3 . • 
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It is very important to recognize that the Functional Analysis process 
elenient specifies a particular level of functional description. This 
analysis requires functional descriptions to a level consistent with the 
troubleshooting process presented. This is consistent with all current 
specifications, but it Involves a change in practice. It "forces" a 
particular level more than any specification does today. 

d. Except for electronic, aircraft, and aircraft equipment, 
troubleshooting requirements in existing specifications only call for 
symptom cause tables and require that the fault isolation must be consistent 
with requirements.^ They do not specify how functional information should 

be developed to guide the user. 

Functional Analysis also calls for symptoms 5 but each symptom 
Fnust be identified with the block which ^contains the parts that can produce 
that symptom (bad output). This means that each symptom is identified as 
a bad output from a specific block. The troubleshooting strategy calls 
for measuring the prescribed inputs to blocks with bad outputs until a 
block 1s found with good inputs and a bad output. Then the block diagram 
of that block is treated in the same way 5 and this is repeated until a - 
replaceable unit is reached. 

e. In the specifications examined j the requirements for non- 

■ trdubleshooting tasks^ are 'not detailed. Generally, they merely require 
consistency with the MAC. "^l 

f^, The text format requirements for all of the specifications 
examined are those required by MIL-M- 38784, General Requirements. The' 
content analyses are not in conflict with this, but do specify additional 
data, 

g. Diagram format requirements were very detailed in the 
specifications for electronic (excluding missiles), aircraft^ and photo- 
graphic comtiodi ties. Diagram format requirements in the other commodity 
systems were virtually non-existent. 

h. Finally, for quality assurance requirements, validation and 
verification were referenced to MIL-M-63000 and MIL-'M-38784, Technical 
Manual Requirements for Manuscripts, But more stringent requirements are 
required. They Include perforfnance of all job tasks by new users (novice 
soldiers^ not 'highly experienced personnel). That is^ to pass validation 
and verification Inspections^ new users* not just experienced personnel, 
must demonstrate that they can use the manual products to perform all job 
tasks to technical standards of adequacy with no other information or 
training. 
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I ishin 9 d if forait scjoc -^iH ca=T:icns tot tnr^ Gifterent cofiiniodUj/ typei., A nnt« 
needs to be tiiade Of th^ f ^i:^ r-y! irc*^>' '''^v-V- .nui .^^^^P''-;- 

cOthiiodity area^a^'e i^etfon ni r^pi. to il ^ i^i^ ^.tvt > > y^eg^i^-'a (.e:^t equi nnm^':! , 

tna^ this is a tr i ti rPhn 1 Pasis -:'or p -n-l: .1. in g piultiijp ^r-n-i ticaH . 

f no": i ncl udfng dePot)/ 

The Ti pi^orfuccr will be requiref! to produco produc:3 ^ '^■^ or ze:"::'::;:- 
specified pr^c&%sH to nieet new bpec ^ f 1c ^ ^jns . It rk .-uf f 1 cn^- 
to Kia\/e the i^e^^ui i^ed f^hnats. The products of Lqu^p'^iCnl Anatysi^;. - t^- 
Analysis, B^ha^^ioral T&U: Analysis, Functional Analysi^^. and Int ^11 t ;nbi ' 1 ty 
p^^o^es sin 9 rriusi be ^pef^ified, as well as the procp^?p^. It should i^p 
rec?:pgn ize <i tha^ the derails of a format for a batter;- chav-cjina ip^to'^ win 
be diffGrent fTont thos^ of a foraat ,for a dual trace sccpr: (there are nio-fi 
knops to Set, ^or one ^h1ng), but a neyi soRci fi cattnn niu^t prescribt^ ^ 
D ^T. :gs s t ha t says "^ll settings on the test instrument will be shown in 
such and Sudi a w^ay afici exanipl es s how hov/ this sane procesi applies to 
d1f-ferent typeS o f^qy ^pfr1en "he forniat specifications for each type of 
ni^te^ are not <lifferen^s though the exainples do not have the same apprarance. 
For instance^ amfupT&s associated v/ith niechanical test ecunpment, enn ines, 
etc., would be diff^^^e^^t fran those associated with coriiplex electronic 
sys^Gins. But 1h^ p<?in^ is that the specified products of the required 
^nalytic Processes v^il 1 be the same regardless of what the meter or special ■ 
equipment Idok^ 1 ike^ The producers of TMs will Kave to meet the same 
criteria ^^epr^^ing fin ^utPut regardless of the type of test instrunient used 
to fiieasure the output, 

The Pr^cc^ss^s represented by the fundamental elements, Equipment 
Analysis. FUnctlcrna " A?ial ys is ^ Task Anal ysi s. Behavioral Tasf: AnaTysi s . and 
intelligibility, apply eciually.well to all Conimodity S^/stems. These are 
processes fu^ iicoiir^te 1y stating now tha.raintenance job should be acconi- 
plishedin ^nt=;?n ig ^bl gra ph^c and written foni!. 

Any of the ta^kS i^ the Commodity Systems are amenable to such analyses. 
Analyses of di tf^rerit ^y&terris^ e.g., h^^draulic. electronic, mechanical, 
w^ill prod lie ^ p^^odiicts ^hst look different, but the processes for preparing . 
the Content ^r^ ti^e sar^^. A complex task can be analyzed in the same my 
aS J sioiple On^. Tne ^r^ducts of . the analyses will differ in length, 
but page for^ p^ge tne ^Ifficinty %vi 11 be the same/ A commodity system 
v/i tri e Id t r^f nos - roqUl r^es -the- -ana^lys is-nf jnore.-iasi:;s.,__hut_tM._arpcasj^ ... 
" for ea ch ar^ t he ^ Saiti^. 
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nnly ^:U\i?.nor -uot:!^?*:- , M.r^-fic: Kind of analj/sis 1s the ' 

L/NjuDiHL^hootinq situawiwH, requires lunctional Analysis to provide the 
■ ^.r-r with fi.'nrMnnMl -nder^^;'-^'M^ rr t^^- -^jKvr:v-^ All other f undani^n tail 
^-ri:;t,r\zs ^:f^ al ^^ri./irp;^ r '-.r^u;;— • v^:- ^^r-h^. ! ion- troubleshooti nn 

'■or.^ cf t:if- Hxi^: ^ijeci f ica^i on s die in conflict: with those of 
:,nn-np- .>rp^,Q.^i j;,' .;v^r..>;i^ T \^f}v cii'T^p Only jri t h c? amount of detail they, 
-all for in T . A new specification m^^t call for more detail than any, 
axisting spHciriuation in" regard tQ^ v/hat prQcesses are requiv^ed. The 
fundani«ntal elements are processes for generating manuals; 

The ore maintenance situation vjhich had a riiajor effect on the funda- 
niental eleinents was depot. There 1s no way to adapt the fundamental 
tlef orit^^ to tha local f^hrication processes prevalent at depot. Therefore, 
(]R-nZ level niain'GnanC'^ was excluded as beyond the scope of this study, 

S . C ha n^ri^ m Cost of Through Fiindaiiiental El ments^ jjjiei-^ 

The Mil itary "Occupational Specialty Training Cost Handbook (HOSB) , 
VoUine U Enlisted MOSs , is the prirTiary source document forcostsJ All 
;:idjO'^ :...:;^n;ands and n-any schools ar^ on the distribution list for this 
docun-en::. The followlrq iG an eKcerpt from the Introduction of the MOSB: 

. , traininq costs account for approximately 10" of 
the FY budget. Toe often the cost of a soldier is 
nuoted solely in tpnns pay and anowances and possibly 
A the supplementary benefits such as free retirernent^ 

health and dental care:^ While this framework might 
appr^opriately be used to describe the functioning soldier, 
it does not take into accoimt the sold:er in a traininq 
status. When a soldier is training, he is not producing 
benefits to the Arrny, but is incurring a number of 
training^associa'ed costs that are not reflected :n the 
conventional cDSLing describerj above . " 



Military Occupational Gpecialty Training Cost Handbook (MOSB), Directorate 
of cost Analysis. Office of the Coniptroller of the Arniy, Washington, D. C^. 
May 1974, ^ 
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Ij^'^ wjMT! ifj/' cour'ses leading to electronic and mechanical n;. i ntenance 
'.hp first; enlistment soldier could be trained in. No course which 
■•neffltnr MOS was included in this anali'sls. The average length of 
■ •- was computed, as was the average cost (per soldier) of the 



, :.,..;:ae lencr.h of a school and/or A.TC courses for maintenance 

■ . -['-'^Uu'A to Geterniine prGcisely across all schools, nOiM types 
-. .j'.;. Course lengths change frequently', but the MOSB provides 

20.6 WEG ks , v/hich.Wc=is correct in 1974. The average total 
these courses 520,348 per soldier. This represents a cost per 
,pr week of about SIOOO. This cost is remarkably constant across 
. ^-io'ii varying more than 20;.. The tire spent in travel and awaiting 
• of the course and assignment after graduation must be added to this. 

■ r'ee weeks on each end of a course Is coiTiTion. Travel can add a few 
■ A figure of five weeks is used as an average amount of t4me in 
. i-^in - activities. The cost of this waiting and travel "time 1s 

>it S300/week, or just slightly niore than the MOSB figures for a - 
L- BCT. Five weeks at S300/week is $1500 'fm- the waiting time. Added 
■ 71.1^8. the average amount spent on tralirlng a soldier' for tnainten- 
:*^e>= is 521,848. the MOSB does riot provide any figures for the cost 
' soldier on the job. But tire ctDst per week of a soldier in 

, -i.-t S300. The cost per week of a soldier 1n formal training Is 
The cost on the jqb has to be nom thwi $300 and less than $1000. 
a figure of S60O/week, this represents a cost of about $30,000 
r;rr. With the estimate of 169,000 full time ntaintenance personnel in 

,. f,he yearly cost of this work force vwuld be alnrost $5 billion per 

in eluding the costs of training. 

■ niirrber of full time maintenafice p€rwnf>el varies each year as the 
cov-vicRS strenqth varies. Ttre estimated enlisted personnel 

■ rh^i Anny at. the end of FY 1974 was 676,000 according to Department 

•■ . i'tdti sties 

. ! %oi.tcg2 indicates that approximately one-third of all personnel 
.• .-rnipd Forces were occupied in full tinie maintenance duties in 1 967, 

year this particular statistic is avanable. It is assumed that 
\'"w nad a somewhat smaller percentage of its personnel in. full time 
-«'iance duties in 1974. There are no specific statistics for the Army 
--\% year, but a conservative estimate is that one-fourth of the flrniy 
-.r-.o] were in full tirne maintenance jobs. This would mean (1/4 of 
::;*)' about 169,000 personnel were in full ffms maintenance jobs 'in 



■ ■ : ^^bstract of the United States, United States Department of 

. , -An Ldi tion, 1974. 

-M:;:dl Abstract of the United States, United States Department of 
31st Edi tion, 1970. 
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ThP rff-nli=;tinGnt'rate varifis over different years but-10-20,^ would be 
a reasonable estimate for maintenance personnel. To replace r-J® lossei- 
of Pxpenenced personnel each year, about one-third of the work force must 
b r p aced with^ew personnel. These are the personnel "ho must be tr i ed 
each year. One-third of the work force of 169,000 is approximately 56,000. 

a . Training Costa 

ThG cast of training 56,000 new personnel in maintenance duties 
Qt almost S?.2,00n per soldier is 51,232,000,000 per year. 

b . Labor Force Costs / 

The cost of 169,000 personnel in the full time maintenance labor 
force at 530,000 per soldier is $5,070,000,000 per year. 

c . Trai ning Cost Reductions 

If maintenance trainina time is reduced 7S«, this represents 
a lowering of cost of ownership byl924.000.000 or approxiniately $.9, biinon 
(.75 X 5i;232 bilTion). 

d. Labor Force Cost Redijctions 

If the maintenaTice labor force can be reduced by 15% the annual 
cost reduction is $755,000,000 ir approximately $.7 billion dollars. 

The total of these reductions in personnel costs is Si. 6 biinon 
(.9 + .7) annually. 

e. Cost of False Removals 

The othpr cost to be added to the 1.6 billion dollar figure 
com-s from the reduction in false removals: The figure of a 151 reduction 
in false removals was brought forv/ard from Task 3. The assumptions invo ved 
in estimating this cost are extensive. A false removal is often corrected 
at a higher echelon, and returned to service. Some false removals are 
thrown away. Statistics on these factors are not readily available. Nor 
are the costs to the system of transporting these parts from one echelon to 
another and keeping the paper work on them. If we estimate that these 
fosts are on the order of $500,000,000 per year, ans% reduction would 
represent a cost of ownership ■eduction of $75,000,000. This is only .075 
billion dollars, little more than a rounding error in the personnel figureb, 
The fiqure of 1.6 bill ion could be rounded up to 1.7 billion with addition 
o-p" the estimated cost of false removal reductions. Irj view of the magnitude 
of the false removal factor, 1t may be seen that Increased precision in 
this estimate is not justified. 
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C . Sumniar^ 

The projected change^ in ens i: o-^" ownpr^sh-^p tb^t ran -^ffi^ctpi! 
a nev/ manual specification is on the order ci' 1,7 hillion riul lars n 
ThR exact figure is not iinpD--^t^nt . ^y<^n if .the :-ic^ual f^icin^e da 
amount or twice that amount, the appropriate action is cnp sanie, T 
changes represented by the new concepts shu Id be implen.c^n tad . Tht^ 
mentation cannot be made nyernight, but the direction p^o"-'p'^^nt i 
it may be possible to make the reduction in cost of ownK^-^hu: nio-p, 
may be less, but either way 1t represents a goal worth ti^:r^iMvinq 
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■ ij ^ ' ; \/'i^^'7C i!i u'S^' m\)rese\]ts an integration 

v;ir--;.,;- N-'; , '^'T^-;;iri? nance ovo)' tm past twenty years These 

c,^^H^..-Mrr. ; .;--:.\-ni:i riDi/iy to rjll situations in the Anny coniModity 
cv^f>u;.L, ^ A:i W.v-.^n -a tf^d s^)ecifi cation based on the fully-developed forms 
ni tj;- ^H^^mei^ts in concepts should produce manuals that 

;:av^ th? n^varrUirob f(;und i fi teists of the original manuals. This incjudes 
.:■ :^':QJCtinn In t^^aininq timti, 151! reduction in the maintenance labor 
-nr;r, vvd a 15 faduc (ii on in false removals. The cumulative effect of 
conibina ti on of f^i .^.ors on cost of ownership is on the order of 
; . bi' : i K)v ^nnu^il ]y . ' 

B^^-;re presentuu;! the integrated specification it is appropriate to 
dc^cnij^e tha eletrtints and give acknowledgeiiient to their sources. 



], Titl^. ipnn '\:nr Performance Manual' is an acknowledgement of 

the (rona''ibutinn of the Air Force Human Resources Laboratory. Dr. John 
P. Foley 0-r, coinad the term Job Performance Aid (JPA). The term "aid" 

tcrr; that probably no longer appropriate. The product of the 
^.)ecif ica^lon is <\ manual. The term Job Performance Manual or JPM is 
-ufficiencly similar to JPA to acknowledge the origtn of the acronym , ^ 
while usina the more appropriate nomenclature. The term "integrated" 
is used to^acknowledqe the contribution made by all the originators of 
new concepts. The contrihutors will find words and phrases that they 
should find comDatib le wi th their views and with the statements they have 
tnade in d^^scr-i ting thoir concepts. It is not feasible to attribute every 
phrase, but those who h^ive worked in this field during the past twenty 
Wars will recognize thrir contributions. 

l^yiHIP^ Anal ysis. The sDScification for this analysis is adopted 
from^ the JPOpecTfi^ation J The process is one of identifying all the 
job tasks that need to be performed on an item of equipment. The Army 
Maintenance Allocation Chart (MAC) does almost the same thing. Task 
Identification or Maintenance 'Al 1 ocation is based on the equipment items, 
rtnd states what maintenance (task) is to be performed on each. The basic 
information for this chart is engineering information. It represents the 
interface between enaineering and the process of developing instructions 
for the maintenance user. It is a management tool for producing pchnical 
iTianua^s. It insures that every major job task is identified for analysis 
and nreDar^rion of in^^trijctlons for perforniing the task. It does^not / 
indicate now to porfurm the tasks it identifies. That is done in the ^ 
fol lowing processos. 

- ' ■ \ 



f-Ui.-J-Bi30«: . ..JOD f'erf ornianco Aids Advdnced "lype, for V'iAF (h"ganizati onal 
Maintenance', 15 March 1971 . (j () 
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3. TajU^Ana1y:-:1s. The Task Analysis identifies the conciitions for psr- 
forminq' each'"iob tank and the subtasks associated with each job task. 
Th« conditions include such things as number of personnel required, 
lubricants reauired, tools required, etc, by task. Task Analysis does 
not orovide the exact cues and responses involved in pertornnng a given 
t,v-.t^', nor how each job task should be described with graphics and short 
v'-rhs. fThis behavioral detail is specified in the Behavioral Task 
,V,>^1 1= . ) Th» Task Anralysis is used for non-troubleshooting tasks and 
the nrocp;'ii-n 1 asoects of troubleshooting tasks, e.g., test equipnient 
5Pt:;n, Tms is a forni of analysis' comTron to many new concepts, but its 
tuily cievelnpcd statement is In the JPA Specification. 

-;. ::'nal Analysi s. The term "functional" means troubleshooting 

f\i\\.-^:\:mh. noY' f uncti ons as the design engineer ■woul d think of them, ihe 
sourrr.-, nf nhis part of the JPM specification are FORECAST and SIMMS. 
Thp prouui nf the analysis are block diagrams, inputs, outputs, symptoms, 
functional -physical overlays, and functional descriptions that tie these 
t-hinn<; tnnpther and provide urrderstartdirTg of each functional block. More 
sfiicnps have hHsn conducted on the products of this analysis than on all 
thp other n.ew concepts combined. The integrated JPM specification iden- 
ti^i^'*;, the nroriucts of this analysis and the criteria they must me^t. 
Each ^imctinnal area (block) of the egoipfTCnt must be precisely defined 
in -^prTis Doth the parts within the area, and those outside the func- 
tional area. The symptoms associated with a nralfunction in each block 
mu'^.t h.- d^tinpd, as well as the correct block Inputs and outputs. No part 
ran hP inrludpfi in a block 1f it affects the measured Input to the block. 
Tho an^iv^is i=. accomplished in several levels. The top-level breaks the 
pni,inri"nt dmvn into about seven functional areas. The second level breaks 
.,3rh rnn ton IpvpI functions down to' about seven smaller functional 
area-^ -^rM -h^^ continues in levels until the snrallest replaceable part 
(-<^ -1 M von orhplnn) is broken out. 

. - ■ - . .'-nntinq concept used in this specification is designed to 
. ^wn inherent disadvantages of the fully proceduralized 

a,:pfnacr .-no take advantage of certain characteristics of a block 

■^,--^'pniira1ized approach, calT 1t tree, or cause/effect table or 
. n. in;i^rpnt d 1 s a d VB H tfl gs s . One is that the efficiency,, of 
;,..-„h . ^ - , - a function of test point "i ndi cati ons produced by a given 
„r' ' means that each item of information collected can change 

ti,^ ^t,:: ' What item of information should be collected in the next 

' ■ . -rocpdure cannot shift strategy or order of steps. Another 
;„ r ,- , ■ = v misinterpret a test point reading which sends them into 
- ^. -uin't be in. They only find thafit is a dead end when 
■ n<i- Then the user does not know where he took a wrong 
lvu> to the beginning. He thus repeats steps done 
Tins is inherently inefficient and psychologically taxing 



-:i)-r 

.-jpH ijnreiw-irHi tig. 
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Xhp block diagram approach avoids both of these serious disadvantages.^^ 
ThP p.nrticular block diaqram approach selected here is- the one tha. holds 
thP user at one level until the trouble is localized to ,a parti cu ar area , 
th^n r^n eases him to the details of that particular are^ to repeat the 
proce-s there. The user never deals with more than aboiit seven blocks at 
a rime" Hp always has a level toigo back to if he mi si nterprets a reading. 
Hp 'does not repeat from the beginning. Also the block diagram approach 
allows for a change in strategy as the user e^PJ^'f"^' ,,1^^, 

user is instructed to always test the inputs to the block with a bad output. 
This single qeneral instruction makes a strict procedure out of the block 
diagram data! But when the user is experienced he can, deviate from the 
instruction of this fixed strategy. He is told he can skip blocks so long 
as he remefiibers (or makes notes) of what he skipped. .iis a' 'f^s hi^ to 
skip to the test points that are easier to measure r nave a higher failure 
rate .or are more likely in view of the test point :a already fl jected 
Thus this particular blofck djagram approach provic for a mixed strategy. 
The one used by a novice amounts to a procedure, _ But 'the user .can use 
other more efficient strategies when he is expenenced. The data grows 
with the user. .. | 

Therefore, the processes for producing a f ixed; prrocedure wi th its 
inherent Inflexibility and inefficiency is not selected in this study, i he 
advantages are all with the block diagram approach. It has. proven its 
efficiency tn rrany tests of large scale equipment jwhi le the ful y proce^ 
durali zed" approach has not proven efficient except in very limited tests 
of small equipments and the inherent disadvantages of procedural ization 
for troubleshooting make it unsuitable. 

A functional description is prepared for each level. It describes the 
equipment functioning at ea-h level in terms of cues and conditions rm 
obtaining the cues. This is the level of understanding thedes gn engineer 
has for desiqning the equipment. The analyst uses more basic, theoretical 
information to make the analysis that reduces this to functional inrm^ 
mation All studies indicate that this functional inforniation is a bettei 
level for troubleshooting the equipment than de&ign theory information. 

There are detailed techniques for making these -analyses on different 
kinds of electronic circuits (FORECAST) but these technical details are 
not considered appropriate for inclusion in a specificat on. Both FOhtCA.i 
and the SIWS specifications''^ call for these functional analyses. 



^Shriver, E. L. FORECAST and Other New Developments in Manuals, Matrix , 
Corporation, Alexandria, Virginia, May 1964, 

2MIL-M-2410aB. Symbolic Integrated Maintenance Manuals (SIMM) for Systern 
and Equipment, May 1972. 
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No attempt \i maue harn uj ^ct^t ^^^y^ r rn^-^ n-/f:inn^ pF c?:'h o-r t^- *^- 
fiew cuncHpts Lo the incegraLad spec ; ri c:^ti cii . Bur these functioncil 
analyses are the on]>' t^^^i'; ' - ^ - i-nr ^..^-^ ^-^-;-)' 
shoocing perf or:nance . Tfi^v un i m: ; . - \= - . si--ii:t^M'y rr/^^ 

inflexibie terie^^ of x v^;.^:- \ - . . ' '. 

to only those." Hs has auidance for riece-r::- ^-u, nrdnr in.-- ■ - 

t^i-'? step^. GuL Ilia forP:.= .. ^^iiowb to .d i;^ n:^ 

the ,1ob v/ithout rvwjativ^iy ^ffc^ctinr: ni3 ^-irfi^icAA-jene^ri. 



5. ^ Behavioral Task Anal ysU ^[BLA^. :'^n-; 0/ ti-.^i n^-,^ ca^^-: , . 
fom of this type of anityiTs', but have rot developed it f.^r^/^^'rl A.-]-^^ 
development was in a particular ::^tudv nn iPAs i'or fhn ^d - '-^-^^J 
JPAs as originally prepared shewed no inp^^o'/od per^nrnan.:o r^-r,r -^^.ryj^.^: 
THs with the group of individuals who ijsed the fir^t ver:'on.- "eh^v'r--] 
Task Analysis was used to Produce two othor yer^^nn;; jpa^: -r 

test purposes. The final ver5ion roiiiU^;::; mi suDStani/i^l M^^^-^d^-^^^ 
in^p&r^ormance levols over atandard techricai manudls, Tni^ :a cU-r 
evidence for the effectiveness and ininortance of BTA. BTA invnlvob an 
analysis Of cues and respons^^s used priir^yruy to pr-;Dar^ >^.-.r^h ics / :^ut - 
also to make the written materia' match the arat^dcc. !^^■;^^^ fui p. 
d-iveioped as a defined n^ethod of anaiysu in a ^iun^^-fient ro;-Drt bv 
Edgar L. Shrivsr on that Air Force test.- It ha^s not beC:n inc"l'ided in 
the Ar gPA SDecif ication . 

The Behavioral Task Analysis ^requires the analysts to perrorm on the 
eqtiiprrient. /fhe performance is the subject 0^ analysis, not the RouiDmEnr^ 
The final manuads contain graphic and written instructions for parfornnnq 
the tasks analyzed by the BTA. The inaterlals must bi Intellioible nn 
novice performers. If not intelMgible, theyy:i-:;t be chanqed^afid te^ Cod 
again. It is not acceptable f^ a JPM Droducer to say that the ^act thr^ 
Infornation is not tinal on a task \s sutficient reason for not Derrorniinq 
a test of drafts (graphic and writtf^n), because thi^ test is for intcTll-^"^ 
Qibinty and not just accwracy. Even if the aquipnent changes before t!u^ 
^i^al Tn is produced, these validations :nuu be performed for in cell i- . 
^Q^b^nity during development. 

The Behavioral Task An^^-ysis is ca^^ied for in the integrated jnM 
spGcificatlon . U is not specifically at'cributable to any one of ^he 
new concepts. Some forni of t^i% analysis is ushc in many of the new 
concepts. But it was not well developed until the test cited above. 
This was th(e first time that it was. shov/n that lack of this procedure 
could negate the others. 



A Report on ';h^ ♦:/a] ^i.^'H of -dnb .— nrr^nc^- AM- t'^-Mi uro^tn;:'^!^ 
Maintenance, AFCS, Weight Patterson AF3, nhio. S -^r --i^hor i97K 

Ohio, 1971, 
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■ ■ ■ ■■ I . i^.. ' ^= V - ' ■ uranhic and written. 

,_^r- r:er;..j'ln njU}^ nnd oxampVhs ^^stnrr-. ^ in it, These materials 

■ ■ ^= ' . ' -. ■ v"..^-^^' =' .-I -'^ - : ^;nfi above strictly 

. u ■ ' ' J; v.-,rj-p;- f - m 0^' ru-iy^is. It is 3 Standard 

; ■. ^. ;■; -L. M'::./-^n.'. "mC wril.ti^n and graphic aspects 

■ .f ■ : f- r"> ;"u^i.:t% .^-f:-:^! eleJ-ent n prescribad list 

nf --^i^;^ ■ V'' l^c^bs . !l ilso prpscribes a certain sentence and 
;-n;:t:; . r^^r■ ' '.■;r^LtGn i t^'uctions . When applied with qraphics it 
resiiiU ' ---r^^-'U] which is intelliyible to users with a grade school 
readM-:. • ;^ v. Trns elenient was first developed in PIMO and a form of 
it was^^M.t-r :.A.,iAy\ in the JPA specification. The initial list of verbs 
wrts -r-r'-i-' ^- ^ r:;^-^ prpsent JPM specification by replacing the multiple 
</nai>^' ui^ ^:hri oriqiral list with single syllable verbs. There 
^v,s hern no new conceDt L.udy that verifies the advantage of single 

v^^^i)^- ^^^v^^^' murtiplis Syllable verbs. But there have been many 
sri.rnp^, .-^n rPciT^ln 1 i ty . \yhich have shown that the smaller the number of 
;;viiaL !pv, the loviev the level of reading abinty required to understand 
rj],:^ oos-^.:U(v fn fact, rost definitions of reading level use the number of 
. vl lliMn^ alnnq viUM sent^nr^ length as part of the definition. The 
.iH'Mnol '^i^-!' wnri ii^t ni^l sentence length prescription resulted in text 
readable at about uh^ nirv;-: qr^ade level. The new concepts of PIMO-JPA, 
and the many pf^ople who have studied readability, are acknowledged as the 
source fnr this part '^r th^^ jpr speci f icati on = 

t. 'Grannie n^pect:^. The fir^c new concept to fully develop graphics 
as d nidiSr tec>m1 m^e^^or iinpn^^ting information was PIMO. Traditional TMs. 
ccntain^ soi^ie qrnphic niaterial . But TM specifications traditionally allowed 
rhp uSH of craphicB only if necessary. _Many of the new concepts used 
qraphw:s extensively. But PIMO mido a full break. PIMO prescribed a ^ 
qranhic nn ever'/ Daqe, facing ^he v/ords instructing the user in what to 
;jr. to the nictu e:i eninomnl] ^ ..^ nraphic became of central importance 
for every instruction - nnt iu:. ; in support of a manual that primarily 
cons;sts^^f words, PiMO, ^.nd later OPA, prescribed line drawings for^ 
qraphics rather than ^ pho taq^^aphs . In practice the line drawings became 
Ips'^ like n:echanjrai drawings and niore oriented to the viewpoint of the 
use-. It is virtuany irnpossible to write a specification on the appear- 
ance of a craph-k;, The integrated JPM specifies that a context and focus 
vieu, of each qraphic be included on each page, and that only the detail 
necessary for^ha usEir to make a match between the graphic and the equip- 
i;:..nt it represnnts be included. There are also certain requirements 
about numerical indexes between the graphic and the step-by-step instruct 
ticn^ associated with the graphics. The intelligibility standards and the 
Behavioral Task Analysis are developed together. The graphic is specified 
as the source of the visual cue information, with the associated instruc- 
tions containina the response action information. Intelligibility is^ 
checked durina the Behavioral Task Analysis. The sources of the specifi- 
cations on intell inibili ty of graphics for the integrated JPM are Behavioral 
Task Anrilysis, PIMO and J^'A. 



7. Validation -Verification Tests. VslidatltDn and verification tests are 
cotnmoFto irasnpecTfic^ations. The 1ir$)ortant aspect of the JPN verifica- 
tion is that it requires a novice user wsing nothing but the Draft 
Equipment Publication prepared under this specification to perforrm all 
job tasks. Tha specification does not require that the validation be 
done with novice subjects. But clearly the validation should be done as 
if the subjects were novices. The govemrrent inay use the validation as 
its verification process if it chooses. 



B. Job Perform ance (juide (JPG) 

The Integrated Job Performance Manual is coniplimented by a Jiob Perfor- 
mance Guide. The subtasks such as using wrinchas, tools / opening hatches, 
etc. that 'are comncm to nany job tasks, are analyzed and placed in the 
Job Perfonnance Guide (JPG). The JPM and the JPG constitute a complete 
guide to performance of all job tasks. But the JPG includes matfeHal 
which soldiers should leanfi, ratter than constantly refer to the JPG. 
The content of ■ the JPG is recorrfW In the context of selected job tasks. 
Content is not extensive. It is not theoretical. It is Just content which 
vfould appear over arid over ©gain in tj-te JW, and increase its vQlum if 
not placed "off line" in the jPS. . 

An o^l^t fm- ^ktW^ is, pro^K^ ^ th« sarre fundairental elements 
as are ^^■m- ^oteWr^ c^torfe of ttT« JPM. _it is vaTldated and 
verified aT^ w#tt- ^le.-^. It can b« used as OJi , or with tape audio 
cassette, or with aatttQ tfisaal cassettes. U is validated and verified 
by tests Witt imv4« sW«ers. TTiepe Is no precedent in the various nm 
concepts for this breekout. It 1s included as a practical measure to 
prevent th® wiPM fr« bOT^S in volume, and In 

fecognltion of the facC -^t u»ra & imm- procedures that an fepeated 
often. As such it ranstitotes a twnlfig pfogram in basic procedures 
which ani required frecpjently on the jab. The content of the JPS is pro- 
duced in the identical way that It is pirodu«ed in the JPM. 

The JPR and JPG specification pp^uced imder these tasks are titled HIL-M- 
632XX(TM), Draft WHtary Sped f lea t1 on for Preparation of Improved Technical 
DQcuraentation and TrainlBftj Part- I. Jrtb Perforfrance Manuals, and Job Perfor- 
ranee Suite, PartJI, TrKt^Ing ^eHals (Si^portlng Job Perforrorrca Manuais.- 
and Guides) .P^ttt ay tttoipeclWcati^ d«flrtcs requt rements for the 
developfwnt iofitJ^* ^ prt^ct perfernwnca of extension trainina material 
(ETM) to ba us«d iiwaroiusrtioa with JPW/JFS documents, In support of the 
maintenance of Anny ^toriel. . S« section m training spec! fi cat ion fol lowing 
the Task 7 descrlptlwi- 
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TASK 6 



Task 6 involved th« firsparation of a sample in accordance with tht 
specif icati on developed In last? 5. Tte equip^nt selected fpr the 
sample was the M60A2 tanik turret with specific coverage of selected 
portions of the armamfeat subsystefn to include the User Range Finder. 
The sample provides gWAiral information, scheduled maintenance, 
troubleshooting, and rMT./'ft-'rtplace procedures at the orgam zationa I , 
direct support and generij support levels. The sample is provided as 
a sepafate" docuront to this, T«!jSOT*t. 
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^ ieljjgsj: Plan 

The F^eld Tost: rio:, Drepii{'pd and subniittud under rhi. c:jr^ 'act it; " 
contained in Appendix F, In cnnibines fiold teht and vese^ra^ t^sc 
cna rac teri 5 ti cs , The plan is designed to evaluate tlie saninle pr^ennr'ta 
in Task 6 in terms of cost, user effectiveness, and user accen laDi m Iv , 
Tne plan is also designed to test any co-ipeting manual concepts or 
techniques. 
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-.•^,Kt: m!L-M"63?;- iri, . ^Vr: nov/ tti orr^orm the nia irif mce and operator 
job "di^ks. .i-^ v/^-^-,. .ro ;..3r}r shou'ci be trdin?d to The current 

r.hiA.:. i vr^s nr ':hi^ ^- , Arirv i'r/^jnirui and Doctrina Coiiifiiand, TRADOC, are to 
•ir^ca^%-> i:ai''''v. iMdLCi^id! which Lei U i^oitiiCtrS vvnat to do to accotnpl i sh ,iub 
Drr^ciuc^s, r-;^ pxdctiy wha: the ' JPM/ JPGs do. Therefore, TRADOC became 
inte^'^sted in tni^ product fronj the traininn point of view and added funds 
to tni. cortr.^-t ro' produce Part II cf Prart MlL-r^-632XX(Thi) . 

Parts I and II use the same f iindamental elenients, ur processes 5 and 
essencirilly the same products of the analyses. Hnv^ever, Part il prescriaes 
th^ oreDaretion of cert^vi administrativa instructions for the neW' soldier 
to ^i-ne as he is exposed to various tasks during his early tine on the job. 
it also ppovides for a handbook that the job supervisor uses to select jobs 
thst a^e approp>"iato fo^^ the new use^ at varioiiS stages of work on the 
job. ■ - 

The JPG contains Instructtons for using common tools and performiTig 
wCmnion tasks. These are the types of things that should be prDgranimed early 
in th^ new usefs dob experience. They are the things^a user will learn to 
do v/ithout the JPG after sr^rne exp-:rience with them. They ttind^to be the 
thinus that are remembered becausa they are freCiuently used, v/hereas Job 
tasks described in the JPM are not as freauently performed . Ttiey wtll not 
be memorized until much late>^ in the user's experience. Soma niay never ae 
memorized. . • - 

To the Gxtent Uiat it is ^nr 1- lont v/1th the unit's work schedule the 
.new user should btr: assian^d certain tasks sooner than others/ This docs 
n t imoly a st? sequence. It nierely means that, on^the averagp^^ the 
new user should Lt assigned to sone kinds of jobs e€fT?er rather than later- 
There is a Training Manacers iidbook prescribed ih Par|t IL This tells 
-thfe Job supervisor/ training nager v/hat tasks should ^omw sooner rather 
than' la ter^^^^ but It does i: event him from assigning any .job at any time. 
The JPM and JPG used together describe how to do any job task. The soldier 
can do ^any job task from descriptions in these sources. He learns from- ^ 
doinq that job task. He will learn certain ^common procedures and^comDn 
^:oois from doing almost any job tasks. However, ther&. are certain' sequences 
of job tasks that will require ell cofmimon procedures and tasks% If such 
d sequence ot thn^^t? iob tasks is coinple^ied the soldier and the supervisor 
know he has perforrned everything in the JPG. The confidence of bpth^are 
increased when this sequence is completed. Thtjrefore, such a sequence is - 
given in the Training "anager'^s Handbook. It is- one that also minimlaes 
the chances of d;in^aqe to Mie e^aiipfnent or the soldier. For each lesson pre^ 
scribed in the Training Manaqer's Handbook thers is a Lesson" Adnnnistr^tive 
Instruction (LAI;, This tells the sol di er •where/to look in the JPfi ard 
what his objective and criterion of performance is on each task th ;:he 
lesson. The MI is nn ^f;'=e than a sinale piece of paper which pravides'a 



begHnning art end psoint for each hour of the soldiers early time on the 
■job. Part Jl also p^o-vides for-- trie use of othe\_ media than the OPM/JPG. 
It provides fpT &ud1o *nl y and audi o/vlsual i nfo'rmatlon. Audiovisual 
v^ould be" used shOW -the "b1g pfeture" for a given equipment. For a radar 
this inightt Pi 4n overview of one or more batteries of radar equipment 
operating together' «q ^cduire, track and destroy targets. If the equip-- 
ifient is a; tank i 9 tank or platoon of tanks might be shown in action. The 
audio vis-ual i sicludes siiottion and TOuld be used to show anything that it 
vJould be incon venierit to demonstrate for a single new soldier on the job. 
fhe audio/v'isu al mods cari also be used to Introduce the soldier to the 
JPH/OPG, the Lesson ysnirn's trative Irstructlons, and how he is going to 
learn by doing. processes for preparing audio visual inaterial are 
prescribed in" Part H. Sut it should be noted that the processes prescribed 
in Part I are the offily pr'oc esses to be used for preparing specific main- 
*:enance/ ope rating i ffst-ructi ons for mai ntaining/operati ng the equipment. 
Tart 11 fls not ari alte-rnsti ve to'Part I. Part II provides for someaddi- 
■f.iV nal msteria-ls t*afc the job supervi sor and new soldier use to bring the 
$oidier -chrOu^ti eany job experience with mlniniuni concern to the soldier 
"mi supervi Sor, and sJd^imLjm bull dtng, of confidence on the part of each. 

The other medium a; 1 lowed by Part 'II is audio only. Thfs medium might 
pe used -fio Pace a soldier, or more likely a crew through a procedure that 
niu^t Dfi perforted witrtin relatively rigid time constraints. An ejcample is 
fjperation &f -che eqUi^merit. Wairitenance personnel have to krov* how to 
ppirate ■fthe' e«3iii PHe "t ^ bsJt th^y can do this at their own speed. They do 
riot Have to be sfdl led operators. But a tank crew or a radar crew must be 
pushed tc>Tigrier skilT levels. The OPM/JPS can only describe a procedure, 
they cannot p^ce pefscnntfl to brfng them to higher skill levels. The audio_ 
Only mode can pace Persofinel. The audio/ visual mode can also pace personnel, 
Sui; tne wis Hat mfidi um general ly Is not a desirable one on which to build 
up skill - Gerierany ^ki1l must be built on the actual equipment or a _ 
rnoc^ up Of it ralherr tha*i through a picture on a screen. The audio medium 
matchefi wvitii the rrai eqiJipniervt or a mock up of the equiprient is expected 
to be used 6x«n3lvreiy fcr operator and crew training. A.gain the content 
-3f tr=iinHng w^uH not be different than that produced by the processes 
nrgscribfid tn i'an U Biit the application of this, content to the user(s) 
■oijld be by a di -ff^rer^t Pedium than paper. 

Also , 10 & crBw^ trai Jiing situation a soldier at one position may perform 
Pa<^t of a pro ced^ff^ arid then wait for another to perfomi part of another 
Proredura etc' situation that the crew is in may require different 
coifibiratioriB Of ba^ic procedures. The crew must gain skilT in recognizing 
situatioffis and p-er^oriflln 9 the proper portions of their procedures as well 
as perfo'niifna theni rapPidly^- 

. Parr It of' t lie sp^d^^ication provides the option of the audio only and 
au.'iiD vi'susl r^edia. does not prescribe the situations in which they will 
he"u-^d T'-t does rtit prescribe any analytic processes separate from those 
^o^cified 'n Part t- The content of the JPM/JPG is flxpected to be the basic 
coritent' for t«i nirnti But the examples and discussion in this section are 
in-rended tc3 s^ow \0n P^X l\ zm be used to round out the basic training 
Qoritent of the J fN/jPC5 and provide for a' sniooth progression for the soldier 
clnd his S(iper-vis or ,^ 
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DESCRIPTIONS OF THE LEVEL OF DEVELOPMENT OF 
UflDAMENTAL ELEMENTS OF TECHNICAL DOCUMENTATinN 



r-:'^. been put into practice. And it 
, = f^^^f ':\''Q1 y vnth it or not. It 

1 s ^nM 1 Ji agranis are functi onal 1 oops . 
''i^L. :ir;d SIMMS in its f Mnejamenta V el emen ts , 
unction.-'H Task Analysis is not described in 
orniluc: (functional loops) is evidently 

r . LciS.^ analysis. For a 1 ] prnctical 
te sciidthat: the fundamental elements in 
-Id be very similar to those developed in 



s. Tfv- one Gxception is that the ''functional loops^ i^spd 
rnr)'v ■iQcumen La ti nn of subf unctions vnthin functions. 
. •v-i-/'^'. -r,:irii/,'rj "ra: ' 'rier this "indented" function within functions but 

ifr:~i.Kr.i.:i . = . lid nn' snov/ th'^s in the rather clear way that 
- ^H^y.w.nver , ' ''i':e ATOi'-iS w^-s ni-ver worked out for a large systc 

\r ;s -or kn^v/n \f the runctinnal diaarams that look clear on one page 
vr-.trr; m.-j/ . ir. r- w-'u.-r. .i^raa-i uvcr fnany p^-cies. This problerin of scale 
hA^-. Uc.nt': n fvs-nh]oin Tor nKfT^^ than one concept as it moved froiTi an idea to 
ion. The MnC's nf SIMMS are a good example of this, Tne 

in an attempt to keep all of a big system on 
pane ^^s h ^d be^n ^^nn^^ a little system when the MDC was at the 



rsi zed pac:pf^ 



This Qn:.^:^n:: has r ^ none bcwanj the ^dea stage, !t has not received 
i:nnl ernon nir; I -.r res-.. U use^ a b'ock format, wherein the blocks con- 
rain s ten-hv-s ^-mj instructions siinilar to PUAO and JPA. The block 
ii anrfiirs' n,., I- ^j^, Je^ r ! i nt ^ s of the equipment functions as in 

FORrTAST anci ' :MMS dosp' -:' th^ .: ''block'^ If developed it would De 

lar i'^ nrovides development O"^ a fundamental eiemnnt thai 

nas not been nio^-p " ]v ^rr/rlo; o by other concepts which have been 
irnif>r:.eni-ed and red. 



idiis ronceot :i$p^- coniputer-^. The nature of the analyses, (the tunda' 
pi^rientr' in tnis^ concepts are not well defined. Whatever =effec = 
rivenuss has bo :n clainied tor the concept must be achieved ough the 
analyses that arr^ norfornied before the computer is programmed. Due there 
]% insufficient : f; rorriio t i en to teld wnat kind of analysis v/as made. There 
are no iio^t rehijlts. Nothing is contributed to our knowledge of Tunda- 
mental eleinents by the information that has been obtained on this<o concept . 
Tiie face that rne results of an analysis can be programijed and displayed 
on. a comDUter is not a contribution. Other concepts have shown that the 
-^^^uits '>f^ cnntent analyses can be presented effectively by lower cost rneans. 



CMG 

This concept has not be^-n irnpl on^n tc^i or testf^n, it is de^-^nr-d '^r^T:-?ly 
for rhe experienced technician who already knov^s all the procedures but 
cdn't y'^'Tiemb^^r certain spsclfics on test point readims. tolerances or 
..r^ruro] sequences. It is apparently based on analyses but they 
specific. The Condensed Maintenance Guide (CMG) is desiun-jted a% the 
experienced man*s "little black book'^ of condensed in^o^^mation. The 
relevance of such suniiiary information is a function of hu\v the man hai 
developed his techniques in his ov/n experience, ^hai is, some typen nr^ 
summary information are idiosyncratic to people. Some aspects of this 
concept might be considered for use as a checklist to summarize material 
in documentation used by the experienced man. But CMG has not been ^ 
implemented or tested. Except for its relative ..niqueness (with CONSD) 
in being designee '^or the experienced man only, it does not hold iiiuch 
promise for use in the present study. This doesn't mean the experienced 
man should be ignored. But costs of ownership will not be changed 
SI qni r^:.rintly by making uhings easier for highly experienced men. 



CONSn - flcnden^^d Servicing Data 

The Condensed Servicing Dair (CONSD), like the Condensed Mai L^r^Tnce 
Guide (CMG), is designed for the highly experienced technician oper^^tn--' 
without the standard" technical manual, or it can be used with the -^n-dc-d 
Tech Order- It appc:r\.ntly utilizes content analysis more so than does 
tm. It includes a list of fault cues, suggesling some kind nf behavioral 
analysis. Like CMG this might h^ve potential as a check^ ;^^nary, 
but it is untested and has not been implemented. AIsG; r . nwimrship 
is not going to be affected significantly by some help fr ■ experienced 
man.. 



DATOM manuals can be used for training and, also on tht^: ir- ^ They 
a-e based on analysis and provide understanding for the u?.:r. This concept 
has not been tested. Rut the fundamantal elements in this concept are like 
those in FORECAST and miNTRAIN. If the fundaTOntal elements were fully 
developed and documented they wuld look very much like those in concepts 
which have been implemented and tested. The fact that this concept uses 
techniques which promote understanding for troubleshooting is an endorsement 
of that approach, but it does not represent any advance in the state of 
development of fundamental elements over that found in implemented and 
tested concepts. 



^LAPS 

T^o key feature of FLAPS is the organizati n of its format for.nuUi- 
..^Qugh the use of FLAPS attached to the ^dges of pages. Unfolding 
a i.uH uverlay reveals more deta;ied information. FLAPS also utilizes at 

i 

B"2 



an 



hn u:^o or oc-. ■.. is 



Center but ^t /^'-c^ itu: t^cr-i - 



ii^i- ;:r:ncnD:. ' ^ ?as ^inalysis and ^"-lain Zng'\)s':^ . ' 

j^.ir 1—. i-.r'n ffffec:^". H'-^ deyeiopmenL 0, thi? fi;; r; t- I r.- 
1^ not 1^ hrrdd and complete as that of PIMO afr. t-^^. : :■ : wn^-- 
f;]llv, it wn./ki be very similar to PIMO and JPA. But in cx^^^- -^r.^^ 

1^crn^5rd dev^ i opnion t in one respect, It tries to reduce r 
rnr lannu?iMe by usinq graphic representations of verbs^ as wen .1^^ 
GPAf^ h^s not been implemented and tested. It is difficult t- i^^-v 
Uirlo^^n^pnt on its unique use of graphics to communicate y£rbs_. 

a u^.e^'i:! rn^R3r-h area, but it cannot be utilized in ^ ^pcci::' 
:..fn -n rnn-;: Jcv^^^l nnmen t and testing 1s acconinl i shed . 

"r.. ;"^^) :r A:d ^ne cic ^o^^ the experienced n^ri v^-,:^^ 

-.uw: ...^w^Pcnd -ian. idea 0^ havinn different documenta^T . 

:^r.. ^"-r;: - rr- ^^h: leveU h very consciously identified if; 
r_^-rr^r ^ [Ik'W.^' Lp^M--er,t documentation for each level H not e^=^^^^ 
PHMH... ;nw- n.^irfp^- nv.^ two levsls in one. During te^^^:. ind v;-;-. 
pvn.;r^-^i::-^l -..-scjnnt^l shov/nd a merkRd di?dain for PIMO documenta-^ 
'n.-^r^^^ni.:di ^ysten^s) chat describe^^ each step in detail. Ihih reo 
;t^^,; .....dp.y ] ^ hut it v/as a reason to cause those who wnrke 

:^r^- :viintTiary level of docuinentati on for exDor ifM^H;e-^ 

.^e.r.r.^r^^i " --.-n p c^^G ^re exai^^ples of a conceDt prcduced for 
;.::;:H.ri^n^- ^ v..r:in-l onlv. FORECAST. MAINiRAIfl ind ot-^ 

des-ignec r-^ uiecrrru.TC troubleshooting all include twn^;n-v:- 
intone levels of organization. 

"-y % -nnrp ha^ not been tested but it n^ay be wn.-;-iv of rnn-^ 
rinn t^o^^ more ^^eserireh in mechanical situations, tni:. ^rfMicepr - ' " 
d queKtiop. It nay. or may not provide an ansv^er. 'die ipjestion :^ 
nwy f'^^r J'.' : oroblem. 

The iTiUitipie levels of organization are used in 
the c:nncepts neveloped for electronics traubl eshuuti ng afid tn\:: 
has no' bnpn deteet\Dd. Often the contrary has been found. ^.\v> 
fo- ^hi^^ s^^: f-con^eious use of the tern "hybrid" and two levat^-^- 
nnrmrc^m; i::iy sten from the fact that psychologists like to Mn;:: r 
enrps in individual reactions and often cater to this rat^^er [.lU-i^ 
nut ti'iross the board" solutiuns. 
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but ir was ^'ine in a siiiiulated on v1 f-onnierit v/hi=:N wa^ ^- -r;,..;^! ^-^ 

nver r'I-:i;, all type, and all araobic fnnnat^. 

!:ven though tr.e acade^nic research or; ihis c-vVhi:' - - ■ ■ 

nr(;i:';t i en 1 cests are rierKied btnore if: Cr-r: be rnn^ i^^^jr^-' 
of fir.],- LeST:D^-i PIMO (JPA) techninues. 

if^^rM--d!: ion on tnis coricepi: has baen n^ird ^: uo^ain. .^^ 
' ::t^^;n in;p 1 en:en ts-i or te^red^ 5o fi\r ca''i n:? dT^'e^^i^ii^^^^-' (-'■y' 
■-vd;r; Lo;ip.:li;d On ] FVR^idpAM does ii!..-, udvanc- Ln^j itaL^:' /o^" .v-; 
^ny fiindament^l elei''ent. IrS p^ffnr-rr based p>^:'^:^^'nv f-: -d ■ 

analysis and orgunized foi^mat^ dor multiple users. U wn$ d^veinoo.^ 'or 
large scale digital equipment. It specifies four 1 cv-l a-d :;>^^aakdawn 
(same levels used in FORECAST, SIMMS and other concepLS or-iriinai -v 
develofK^d for large scale systems) achi6:ved through a zop-^c-n a:;a'L:i: 
(also common to FORECAST and SIMMS). It beaments in^ormatirn to what 

needed at each level (as with FORECAST and SIMMS). But : procecajr^a 1 i z 
. informatidn at each level. This^is different f^^oni FOR"CA::t aiia ^';]:"'' .mn 
siniiar to PIMO in intent, but there is not info/a::j tion nn wf. ^ 
drocedures loo^^-^d like o^- ':(f.-/ tiiey were derived frcni anr'ysis. \: 1^; 
intHr^M^ting to '-otn that trw^ integr-tion of e^ementa in thi dac i f i r ^ • en 
ievpioped under this ct^ntract rrodi.a-'? a nrociuct that ^a-. a "--ararr^ 
-Vf'AG^AM, The Drocedural infoniias^on ana information fyr ^mrrrstar r nr; 
^^"nd ^a;r "^■'onb "i e^hoQting tdsks is si^Tillar in ^^^oncept PV^^AdnAM ' 
;:;rncedural i ti jn of informatinn at each level troiMl ashccti n \ 

XRACj;. 

The wrfniar^v feature Of TRACE is its use of ::1 a .r^i ci zed cards wi t;'-^ 
hnles aligned over test points on printed circuit boards. TRACE uses 
sor.e ^orm of task analysis to identify the proper rest points and 
orqanize then; into sequences for testing, and it a"!^o uses snme narrative 
with qraphics in addition the blasticized cards. It aasunie^ the , 
technician nas aDackground in design theory, knov/ledqp oi rde systeni 

>fr test: afiu d '^r:d 1 e * en cy in the use of test equipinr The card doe^^ 

\^rAz the user's actions to probing at- prescribed test Doint-. and thus 
:-"V;tects other oarts o'^ the enuipmant froa damage. ! t asOo 
anique Dlastic card no achiev^^ its effects. It does f,at of.'-^ ariy state 
of the a^^t '-n irrar^aveinerit over more fully deveiopeci concepts ^'vi the 
f^^lrraents it u. ^s = except for ^he plastic card.. The olastir card wi in 
holes is a un.auc iinpleif^entation of an elemmt that needs to bs researched 
fo^" pos- ible^utur-y use* But it has not unaergciie anv test^ and shou' ' ? 
co'jsidered oniy for -^Sfid'^h f^ath^'-^. than fmpTenienta t i ^'-n the pre^*^-r 
time. ' 

1 » i 
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it prr;v idc};,> an opijor^tur' uv to rna'-e a ^ujor 
nr;:wooii iiiacnin!^ :c:,iiru: arr. Mj!.idn :-jSzu:y. ^ ' ^ 
and paople do not have the sanio :5ons.j^^y Cd: ■ 
?;ense pattern^ c^cilliscope pytl^rns/ as e^.:'" = 

hunions Ho nOL iiiako i:;eosurenion ts as ^- ' i;;n^:hi iies , • ^ 

analyied to ui:ili;re cubs that [uiinafv . ^ense eas^'v. i 
different analy^s than that used i v,Mdr y.-y '.-y, : • 

in^iVircUnfned to Le!.t. Howe ve?% the r /tnt t^uit : : 

-;5pd to vyor^k Out r,oUitions that riate ...in tt^chr^i c ; ain^ ;-c:^-^ "; 
tor pf'oqrafnfin nq n-achine^. There are nidrw ripDroacnes ^'.vit ^ 
h^;-r r^ochine^}, t^A^. L nrri the othe^^ autor:ated test^nn ^ . 
in this {jroiect nrr iust d samnle. These saniDles arv ;i^-^nv1:>:^ : itj:- 
tify then^ a class of dppiMiuChes wnich a)^e different ^' r^-: ^>\i'-^ -}r 
the approaches which are th*^ subirHVt nf this project. co:-: -pt^ i 

t^elevance to this project use analyses to accomplish me ^aitio n'^ri'i-sos 
as do the analyses for prograniiii ng automated testino ec^u i r^rnpnt , bu': the 
content. of tiie analyses are different becciuse the sen^^n)7 and nth.-^ 
characteristics of humans and machines are different. Analysis is -'^^^ 
just the province of the machine; the use of analysi-^ is conifPtn to hr-rP 
rnachine appro^iches and people approaches, 'Hie effe''^ ^ v-.i^y.^ a; ^ - 
has t^en denionstrated in both cases. The present prajpct is ai^^^ed 
usinq peoplo lo dn the sens ing as v^ell as acc^mpl i shine the r^rp -^-n l 
to ef^ec t' rt^pa i rs - it is thel^rennso oF the present r^^nip- t ^hit nhi 
.■irujroach will have a greater in:pact on cost of ov/nershic than wri'^^- vh^r 
ichjne appr'oach, at least durinq the next five to ten ye;r-s. 

The Work Package Concept uses all the fundamental elements -t PiMO, 
JPA, etc,, but it does not carry any of them to full devel npmen t . Wiion 
those tundai'iental eleinents are user; in tneir foil s U te-uf- tne--a r ■. wr;:= 
they enable novice personnel to do effective work without traininn 
witnessed in field tests of PIMO and JPA, The Work Pac^ace Concrpr \r,^: 
the fundainenta] ■■dements in a relatively rudimentary form^ so the us^vr:^ 
;'iust bring e> ive training in design theory and equiprnerit u^rtne, -to 
' , the work s !on. Thu^ the concept ^ai'^ to achieve e-fprr^ 
^'IMO and JPA na . cil ready demonstrated. It is true that thr^ Woid. P icra 
:_nncopt does utilize a rel a ti vely weVl developed' organ i^ati^n ^t-.M^at^ 
t'-oijcht toqethpr in work packages. It uses a functional ana-ysis ti' 
sijine^ deqt^ee to Prepare subordinate work packages and ^eferen::e ther^ 
highpr order oackages. Sets of work pdckaqes are D>^epared ^w>M rh ^i^ix^r:: 
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^^'r:;li^^:.^ru■iO:: ino fro^i nnn=troublGshooting i n ^^niati on, and e^ch of t-vj^^t^ 
r-Mn p- ;:i :in of op^^rdtion. Other hr^eakL .itn ar- made fov-^^sirinn 

:i'-r];!:vi:a;:inM of thi? docunpn f'a t i on pr-ubably -'^a-e^ if; easic" for Uih 
r.vr. i f; - ri/r: vn^^ ■■■i c^nLe'' i-a-^ ntGnance man than st^^^^drt'^i docu'-on- 
\'^ut cr-i^- nre not data" to dQiiiOiistra::} 

^'nt K ri<:kege roncept is unique and yt= v irMno^^tant exanipltv .■ 
M v;\t;: : I ivDH cf situation. U uses all the ; ^ -^^t fundamental elnnien^.^- 
n;:^^ u:ti: c^er^ to Ln(:ir ruH extr^nr. ■ c i f technico^- 

ri::-rF, ^iain1n^7 £i runiniefitary understanding o 'i^:^ variaus fundan^ontc^ ; 

'ppierits. brtrjfln putting them Into practice vvl ch bene'^it of specifi- 
..c:-:icns. uuidHncP or quality control. The resu i can be lauded as a 
-(•■ve ^he riaht: di ^^ecti on, or it can ^be condemr--'. as a poorly exccutea 
iirn^enianration of techniques v^hich could be and neve been implement^^d 

-ch bptUir. Iha Work Package Concept is clearl^y ;iot well^ennugh imrd^:- 
,.Mnnv:d to guide novice personnel, and though it ma:;' t£ an improvement ^'^vo 
*:radirinndl dacumenta ti on , it will not support the pe^formanc as well 
.iK cor:Ceipts cmplD/1ng v/ell da^^eloped and implenjentti-d fundamentci = elen-Gnts 
wi nh f-B^Hf^ct to costs 0^ ".^neridilp this means the Work Package Concept 
,r - nn]./ :?r\:vi-;-: maruin^t decreases in the cost of ownership wnile 
'p.uuig uid^or cosi; reductions u-touchec. 

!f further ^^esearch ann development on this concept is contemnl ated 
it. :diou;d eithe-^ (V' be adapted to what has been fully developed 1n other 
:uncRptf^, or ic)' it :;hould be tested against such other cuncepts rather- 
■hnn against s tandarc documentation = This field is now too well 
df:.^clopO'' fo^^ ^3 denonstr^ttion of margintal i niprovements over ^tandarfJ 
:!-tui:.en! niofK The anal now has to be improvement of fundamental element 
l:^";-. navt al.^-^aciy shown v^r^ substantial improvements over standard 
■i.::umn t^: -rior . 
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^J;jnir- to th^ rntn in Taolo K tner^^ ^;r^ other points to be drawn 
;- rnr^ sLudip^. ^^nc? di5cu5Sion OQ&G no: uirsciiy ii!::r,nge on cosi:^ uf 
..-.orsni::- as ao t^- dnz:: rro;n TaDie 1. However, ifi studying _the relevant 
.:,-.:i:.T:H^t:. M'^ L'r'^^ur./ m-j seuondarv sources, thr^ follovving points were 
^electe-^ d^; ancillnrv iMDints, deserving of discussion. 

1, 'lon- F" I £::;noct1 ng Taak s 

Woi-v Force Loatinq 

1 ;'-,<n uf Control. Ae part the F=4J study as discussed by 
-hy^^AU', i hypothetical work center way iTM-^Med mathematically and manpower 
J- • i:ation" inpl icat-ions explored, ll 'JO 5jr^,;;;cted that, using the 

■ 'iiQi tional '"'anijd"':, 71 percent inev:;^ i enced labor time is spent 
,:qnrvinii assistina exper ; ceL-nnic 1 ans , Using nevi proceffural i ::ed 

'33 Dercent of^lnexpe, ;d work time would be spent performing 

■ H ;:'_nniinc-^ nnd the reriaininq tiiiis in as-sisting. 

Mnotr,ef btiidv r-:viewed by Rowan' of the MC-8A mobile electronic power 
rnant indicated that an experienced technician could keep at least four 
^nc^vpprienced iren occupied usinq JPAs. The work situation did not pen,i>t 
t^stinq the capability of experienced men .to keep -even mor?» apprentTces 
Dusv. ' Thus, tne poteni;ial for increasing thB«4upervistr ' s span ot control 
;':he nuincer of tasks that can be supervised at one time) seeii.s great. 

(2) !nventr--y Mr' intenance. Rowan reports anot''^-'" finding from 
the :'-'<'rO study concerning error rates for technicians with and without 
■-■nceaur~l i?HG manLidl s . For experienced Dersonnel , procedu?'al errors 
jj,f-rB,Hc;pd from U to 4 percent. As discussed in this report, procedural 
^.rrors ar^ a matter of definition, but at least some of these firrc-; are 
HkpIv rn :iffpct the spare part inventory and distribution systeni, because 
th^'v l ^-ad to unnecessary repl acem^Mi ^^alse -emovals). These data suggest 
that the "float" renul reniE: nts fo"- p"i-e equipments and assemblies can be 
f'ediiced by partaDS 15 percent. 

t. Equipn:ent Utilization ■ 

(1) Mean Time Betvveen Failures (MTBF). The second consequence 
nr reduced errors is a reduction in technician-1nd"'-ed rr-.nnonent fa i 1 ures , 
:y!ta on this effect require lonn-term monitoring up-time% and 



^ Rowan, Thomas C. Iniprovinq POD Ma intenance Th rough Perfonnance^ ^^^^ 
ARPA Order No. Z244 , P^roject Code 3 D2 Of Advanced Rtsttarch Products Agency, 
Washington, D. C. , 1973. ' 
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nas nut ';?en developed, PIHO (Serendipity , 1969) , howevei^S orojected 
such effects using a mathematical model, and it seems reasonable that a 
^^eductior in non-troubleshooting ^rror , in re'^^^-''.'i' . ^-'-^ntim, and ^e^- 
-ent will reduce system down-tine due to such -v^-]'--.. ^n? cost o° ^r^^ 
'.:^^ect is difficult to project. It ronui>-es .I'-n'^" i : ^ nn each tvD^ 
y^iv-^ pqiripnent in the Arn^'/ mventorv r^f^--; c 1 ^ ^hp v^'-o 
'ncreassd ''up-tiniG" for each. It is not =^-:c1jc^:^ ; c 
''^ tnii study. Gut it should bs nccogni:ed C!^ ^ . " ,.''iJ-, " r:! ; 
jw^ld increase tne dniau:-ts actually confiutec . 

- ' I ro iH^l _G S hoot i n g Task s 

.1 . Fa! se Remova 1 s 

(]) Inventory Maintenance, An '^Opti^-^-;"^ ^--^cn! ci^nuoni/c ;mc^ 
SUidy" (Naval Weanons Engineering Support Act^ / . ^■: :^:v^ t'^-^^- 

"^lodt** requi renients may be reduced by cons9rv^-^: Aim- r-- i 

used only 9 percent more spares than absolutel ' -^^^ ;^fn'^ cr.. 

■^ A'-un]^^ JourneyiTien used 20 oercent ror^^ :-n^^^-*^ '■^\t ^':c ^ ^ j 
-cmuaiSs and 48 percent more v;1thout thPnu 

These data resulted fron; a siniulation and ^ c. ; ^■^:■'■4.:t ' 

conservation in the field. Ho\vCver^ sii'iiUr f^inc^c-:, iOre cbtciv^cc 
Cart the PIMO study. Specifically, under '.^-'^ ^ cv-dif^ons, 
rive-fold reduction in the replacement or unn^eacc Wu^ ci:scrvpd 

using a simplified Maintenance Dependency Cha^^^: 

^^^se projection of these costs is not-^nclutrt ■ - ^Mn.^^ 
t.;; they v/culd represent an additional savings. 

b. Productivity on the Job. 

M/ Meantime to Repair (MTTR). - v'- m.-.;;.-^:- 

^,Mjws -^-^at two se:^arate FORECAST stiidies re-iir\\ \ ^ -reives i- 
/mard "My Oi -7 percent (1900)2 .^h ^^-c^rt 



'^^roject PIMO Final Report, Contract AF04-(63^^0^c- , bc:^end1pi tv , mc. , 
"natsv/crth, Cal i forn ia , f^ay 1 359. 

■J ■ _ _ 

"Shriver, E. L. Pete rmin 1 n g_ Trai n "i ng Rec[ u Irenien t s f or J^l e ct ro n 1c ir'" 
l-\a intenance: Dev el opmen t aiid Test^ oX a_ New M of Skin an d jsnov;le 
Analysis. HumRRO Technical ReDort^ft3, JunFTMOT ' 

'Shriver,^E. L,, et ai , FORECAST Systems Afia U'sis and Training Metrtnd:. 
'•0'- •^la."t.ron1cs Maintenance Training , ITunM^^ l^epO)"riInTT3\^!fly 
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reported 14D Dercent (1965)^ and AVIS m percent. Productivity increase' 
from HAWK (1964)2 ranged from zero to 106 percent. PIMO using MDCs found 
a I? pe»*cent increase in productivity. FEFI/TAFI Increases (1969)- were 
:14. perciMit' undar unique ci rcunistances. Rowan reports the F-4J work center 
•■n(;,i" -ro jocted Improved departure reliabiHty of '50-55 percent, with a _ 
■•■-.lO ppr-'ent iniproveinent In operational readiness' (1973).^ .These data a- 
he projection that MTTR can be substantially reduced with inir r.-. 



I ach- ical manuals. 

.;, TraitTing Time Reductions 

(]'•' Training Reductions. FORECAST reported reductions in 
r— ininq time of 60 percent and 56 percent, JOBTRAIN 50 percent, and . ■ 
•■.:^A (1 967 )5 TOO percent and (1971)5 of 5% and 20-. Rowan repo 'tK tfnm 
FMMO studies (1973)7 project from models that training time can ue reduced 
2^ percent by using OJT time for productive work. 

(?) On-the-job Training (OJT). Post and Price (1972)^' suggest 
that inodified JPAs can be an effective OJT vehicle. Such use is not 



tF-d by the experience of supervisors and trainers. 



^Tjaers, J. P., and Walter, T." H. The Developmen t and gv o1iitjOD,Pl.ia 
improved Electrician's Troubleshooting Manual, RumRRQ Technical Report 
65-ir>larc5i lW5." '" 

"Rnaprs, J and Thome, J. H. Development of a Procedure-Oriented 
Tr aining Program for' HAWK Radar Mechanics . HuniRROTidiriical Report 
ePlT, December 1969." ' 

^ DC-JO Fault 'isolation. McDonnen Douglas Corporation, Report DAD 68a47A, 
October 1969 r 

^0£. Cit. 

hairy spy, A , et al. Job Performance Aids and Their Jnij_ac^:orLMan£Ower 
iLti Hzatjon. ,EDL-TR3270, Phllco Corpr, Palo" Alto, California, Nay 1957.. 

^Folley, J. D., Jr., et al . Fully Procedu rail zed Job Performance Aids. 
Technicar Report AFHRL-TR-71-53\ WPAFB, Ohio, December 1971. 

/Rowan, Og. Cit. 

®Post, T. J. and Price, H, E. . Development of JnnQvative Job A_1d_ Concepts 
V Glume I •■ Description of Concepts . ' MAVA IRS YSCOM", Ar 1 i ng ton , 1/ i rg 1 n 1 a , 

May^T972; ' . ^ ' ' - - - 
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(3) Cross Specialuation, JOBfRAIN withheld training on one of 
the equipments. After just one day's fainniarization, tra1 nees \isi ng the 
new manuals performed satisfactorily. FORECAST demonstrated satisf actori^ 
transfer from a sifnulator representing only a portion of thii svs;t'jHi ic- tfie 
entire system. Foley (1972)1 points out that, using ^;L.'.ndard tra^ninn and 
technical inanual s^upport^ training for one specialty renuires 37 i/i^eks 
plus 24 weeks OJT, after which the enlistee is still only ^:^f^^e.:(:ivt? on 
the system for which he 1s trained, Restssigninent require;, additional 
OJT, and perhaps some additional forinal training, 

(4) Tour Effectiveness. Inexperienced per::;^ finel usinn the fifev/ 
job guides were able to troubleshoot the F--4J as v/r1 1 or better than 
experienced personnel Substantiany the same findiiiqii vmre reporttfri by 
the Naval Weapons Engineering Support Activity, 

The cost savings projected froni a reduced labor force with iniproved 
per fonnance are included in the cost projection^ but the estiniate of 15 
percent must be considered conservative. 

«♦ - ■ ^ 



Foley 5 J. P. 5 Jr. "Task Anal ysis for Job Performance Ai ds and Related 
Trai ninq . Training Research Division , WPAFB, OhiOs October 1972. 
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TECHMICAL /MANUAL SPECIFICATIONS,REVIEWED 



LIST OF SPECIFICATIONS 



. MIL-M-63011 (TM) 30 December 1972 ' ^ ■ ' 

Military Specification 

Manuals, Technical: For Maintenance Test Flight of Aniiy A i rcr aft 

MIL-M"63019 (TM) 15 October 1969 
Military Specification 

Nanuals, Technical: Telecommunications Equipment (Except Tn'^etypei^nter) 

MIL-M-63021 (TM) 15 December 1969. 
Military Specification 

Manuals, Technical:- Tel etypewriter Equi pment 

MrL-M-63022 (TM) ZZ December 1970 ' , 

Military Specification 

Manuals, Technical: For Electronic Configurations (Aircraft) 

MIL-M-63024 (TM) 9 February/ 1970 
Military Specification 

Nanuals, Tachical: Photographi c? Motion Pictures Sounds and Recording 

Equipment \ _ ^ . 

NrL-M-63026 ^(TM) 15 March 1969 -^^^ ^ 

Military Specification : , 

Manuals, Technical: For Arm^ Aircraft 

MIL-M^63027 (TM) 13 March 1969 ' ■ 

military Specification ^ ; . ' 

Manuals, Technical: Maintenance and Overhaul Instruct ions ^(Aeronauti cal 

Accessopes and Support Equipment) 

MIL-M-S3028 (TM) 31 January' 1969 
Military Specification 

Manuals /Technical : Manuscript Requirements for Maihtenance of Aircraft 
^ :.■ Engines and Engine Accessories 

MIL-M-B3O30B (TM) 1 May 1973 

Military Specification ^ 

Manuals, Technical: Preventive Haintenance Services 

MIL-M-63032 (TM) 25 September 1968 
Military Specification 

ManuaTs, Technical: Manuscripts Requirements for Weapcns^ Combat Vehicles 

and Fire Control Materie.l 
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LIST OF 'SPECIFICATIONS 



MIL-M-63041 (TM) 3 Septeriber 1970 

Mil itary Sped Fication „ ■ ^ ■ 

Manuals", Technical: Content Requi reiiients for Depot Maintenance m-k 

Requirements 



MIL-N-63043 (TM) 27 May 1970 

Military Specification , ' 

Manuals, Technical: Missile System Equipnient Check Procedureb 

MIL-N-63044 (TM) 2 September 1970 

Military Specif icati on / _ , , 

Manuals, Technical: Missile System Erjuipnient Um t-Under-rest (UUF) 

Procedures 



/ 



MIL-N-63046 (TM) 2 September 1970 , , 
Military Specification / 
Manuals, Technical: Missne System Equipment 

MIL-M-3a7a4 (TM) 1 May 1974 

Military Specif icati on 

Manuals , Technical ■ General Requi reinents 



AR 310-3 December 1968 

Military Publications ' / ^ ^ a 

Preparation, Coordination, and Approval of Department of the flrniy 

Publications / 
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DHPOT MAINTHNANCE 



Ffie inal ntennnc'^ 'riv. • ; /I'm r t characterized in Task 3 was borne 
out in tfio cofiiinociity 'v^rorim investigations. The extent to which tools, 
to!3t enuipinent and r.:y.nt;ie^ are provided tends to be a function of the 
echelon of mdimeimncv. Tne higher the echelon the greater the support 
proyidecj in of "ools, t^st equipment and facilities, processes, etc. 

This is to a areat sxnent deterniined by the complexity and support 
requi /^eint^n t of various ta^sks-aiid the allocation of spares at the various 
level "3 of ilia intenance.: 

Hnwever, based on our visit to Corpus Christi, Texas, Army Main- 
tenance Depot, we detcrn^lned that this factor of the Maintenance Environ- 
ini?nt has characteristics that differentiate it from other echelons, ^ We • , 
no lonqer believe that Depot level maintenance falls under the purview 
of this project. Our reasons for this change aVe detailed below: 

Helicopters are usually brought in (some flown in) to depot'. There 
is some general diagnosis performed in which togged hours on engine, 
transmission and main rotor .assembly is an Important aspect- It 1s the 
exception when a few^ things are corrected and,' the aircraft ,is returned to 
regular duty. The common actiDn is a virtual/ly compTete strip down to the 
airframe. After the strip "down, only the engine, transmission and a few 
other items that were oniglnally on an airframe are matched up with that . 
airframe again. All other parts are sent to' a pool , "^he depot also ^ 
receives parts from lower echel ons ^ as well as complete ai rcraft. These 
are treated as a pool. The depot "owes" various "custofners" a certain 
number of parts of a given type but they are not cent rone d by serial number. 

The remaining discussion refers to mechanical aspects down to the 
fDOint where electronic parts are identified as a separate topic. 

The airfranie is cleaned and so are all the mechanical parts. The 
parts are inspected. There a re cri terl a /for the inspection established 
by engineering control. The criteria are a function of manufacturing specs 
anj. the locaV situation. The criteria are based on make or buy' decisions. 
For instance, a floor panel niayr 

1) be bought as a replacement par^ti 

2) be fabricated at the depot from scratch; 

3) be reoaired if damage is 801 or less. 

^ ■ / ■ . ■ . . 

The extent of repair is a function of;how easy (or costly) it is to get a 
new ftem. An item like a floor panel/may be completely out of production 
at the subcontractor's plant that orfgiaally set up an assembly line to 
produce 50O0 of these items. If the/ item cannot be readily obtained from 
the subcontractor it is produced at /the depot.. The decision, on whether 
to make this part from scratch at the depot or make a repair of it Is based 
on local cost' factors and^cost factors regarding enti re purchase - make 
or buy decisions based on local prpcesses. The same decision is made on. 
making an 80% or 30K repair. / ^ 
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Other parts may have been eroded to 3 thousandths or 8 thousandths ^ 
of an inch* The chrome plating departnifint may;^e able to deposit an aniddnt 
of chroine on this part.^to "iiiake up" the amount eroded. This is a variable 
aninunt. And some parts may be ton large to fit in existinc) chrome plating 
vats^ The decision Qgain is a local one based oh local ttianufacturing 
capability, There are thousands of such local decisions. The manufficturer ' 
speci f ication on what the parts should measure will not Hf^tf^rnnne vvhat 
processes are used to get the parts to those diniensions. 

Therefore, it is not practical to prescribe pp^^fon^iances ^o^^ 
accomplishing particular processes in depots as the^^e is ^ w/i/ 
of accomplishing the job. The processes at echelons below deDDt^aj;e 
standaxd and can be documented .in "how to do it" books beca-use there are 
no decisions on what process to use. The process is alv/avs replacement , 
Documentation which describes , the process for replacement of parts is 
standard when replacement^ 1s the process that wilT ^e used. But at aenot 
there are many alternati\^es to buying replacements ^^om the o^^iginal 
manufacturer, The depot has a manufacturing function/ Hovv much nianu- 
facturing^ and the most cost effectHve process is a function of many 
factors. There is^ no way to solve all these answers hefo^^' the ^iic" %o 
it is impractical to document specific solutions. 

These decisions regarding the process for repair of Darts are not 
the^-OnTy thing going on at the depot. There is also the .assenibTy process. 
This is a standard "process. Parts arrive at the assembly line and they 
are assernbled in a standard way. ^ It makes no difference to the assemblnr'; 
v/hether the parts delivered to them are new^ built up wi^h 7 thousandths 
or 2 thQusandths of chroine or whatever. The parts d^Tiv^rt^d to them are ■ 
standardized parts regardless of how they got that wa:^ 

The assembTy process can be described completely. But there is a 
question of the extent to which the detail should be described. If we 
assume nev/ empl oyees , then the process should be de^:rin^d in qreat detail. 
But: if there are many old exDerienced personnel t:h^^ ':!f^t ■ 1 s ^not ne^^^i*^:K 
Clearly a depot does not have the turnover in personnel chat the lower- 
echelons haves and some people coming to the depot have h^id training before. 
If depot operations were to, expand quickly (as in v/.ir tim) there would be 
an influx of new personnel. So there is a question of v/hather assembly 
procedures should be described in detail for depots. It is clear that 
they can be for assembly procesSi but there is a question of what the_ 
"pay off" for doing it 1s, The number of depot people is not great with 
respect to the number in lower- echelons . 'Doing it or not doing it at depot 
level is not going to have a large effect on cost of ownership under 
current situations. If rapid expansion is necessary the 'pay off" of ■ 
havina assembly processes docuniented would be great. But it is probably 
a lower priori t/ 1 tem under current conditions. 

There 1s. one additional idea that should be Introduced at this poi-nt, 
It is that manufacturers have been increasing the use of iob aids on their* 
assembly lines. Videosonics is a job aid' Hughes developed to show its 
people how to wire certain circuit boards. So continued thought should go 
on this point even though we say it 1s a low priority for the immediate 
situation. It should not be forgotten. But when it is considered it should 

E»2 ' _ 



hp dotip in n larger context, of job aids than we are.doing in the present^ 
study'" We ;rrp focused on pictori al-1 angiiage job aids that go on paper or 
film or videoscreen. There are other types of job aids - especTany .or 
or^diHtion prore^.^. There are jigs, for instance. T.he wirTng harnesses 
th.^t'-^iere Qsseinbifid at depots had jigs to guiae their construction.^ 



...-wood ^ ins 'had damps on them to hold .wire. Lines on the plywood showe' 
Icnv; the wires should be, where they should go and how many to each 



ooinf Ofh^^r informdtion m% calso on the job regarding connectTng the ■■ 
wires' ^0 - in-: on connpcfor piuqs. There are a great variety ot job aida 
in fl'Droduc Li on /manufacturing plant that go beyond those documented on 
oapp.-;" "it "would be inappropriate to go into a depot environment with on!./ 
the type of job aids that are needed at lower echelons. . 

This is another reason for not making definitive statements about 
,|..r.nt maintenance in the present study. The big changes in cost of owner^ 
•h-ip ran be made with paper aids at field maintenance echelons. We should 
limir our conclusions and docurnentati on specifications to those echelons 
of hiah payoff and hiqh applicability for the present. But we should also 
initiate broader studies at the depot level. The "crUnch^ 'fn"??-"". L ' 
at the moment as it is not wartime or expansion time. But all the advan 
tages of job aids -in expansion are cl early critical . 

Now let us discuss electronic equipment. The process is entirely 
alff^rent for repair of electronic equipment. The depot does not take all 
thp narts off of electronic equipmart and replace them. But for cT"cuit 
hoard avionics pquipment the process in depot is much like it is for tube , 
type, non^modularized equipment at field echelons. The depou People 
trnubleshoot electronic equipment and replace only the bad parts. But at 
riFpiTlhr^uipment is likely to contain many unrelated bad parts itieia 
echelon personnel, knowing an Item is going, to depot,, will ^ J. ^J^^ 

every manufacturing card they have). The personnel at depot see the same 
modules over and o2er, every day. They say they learn the idiosyncracies 
nf those modules so well that a subtle cue like an i ndi cator wi ggl e or a 
V'iqhtly irregular pattern will suggest the failure or a particular part 
they have experienced as especially v«ak in this module, in snort, ■ 
through intense repetitive experience they are. able to go ^r°'I' ^^;i^^l-,u^ 
rue to a highly likely bad part. This, is a very useful technique when the 
pquipment is packed with a multitude of unrelated bad parts. This situation 
^s qijite different than that in field maintenance echelons. Documenting 
the Drocess for depot would provide a different product then documenting 
the process in field repair shops. A iogical troubleshooting process may 
bp inefficient at depot but highly .efficient in field echelons. These 
observations lead to' the conclusiin that docurnentati on of different processes 
may be appropriate for depot and field. This is not so. astoni shing because 
fiPld^and depot are likely to require different documentation an^a^, just 
because they are focused on different parfs of the same equipment; e.g., 
dPpdt on parts within a module, and fieVd on modules within a larger system. 
This aspect of the situation has always. been different and requires . _ 
different documentation. But our observations have led us to hypothesize 
that the efficient troubleshooting processes (as well as content] may De 
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different at depot and othef eche1on$. It would appec\r thnt cost of 
ownership is not goin<i to be affected greatly by thiG di^tinrtion, 
if we limit our prescriptions to (^cndlnr^ -'olovr d'^pnt:' wc Wi M hdve' 
basically the Srinic^ f impact on co^t or o^^/norsiiip i \riu'\idh(\^v,:c'.. 
And the aclvantaqe ■a<^ not addr/^ssinci vjr=j.}OL nperaticr.- thh' riiip^ '-. .n^t 
':he situation there nkely to rec|uire a dl f ri:jrc:n ^ 'vrilnriiin of [:''r.y /^^v- 
tions (like including other ^ob aids thdn 2 dim(^nn ona i ) , tncin . F i .^^1 H 
echelons. We, therefore, avoid qiving a uresoMpt^cn ihat :it::s d i^ji n^iha^ 
different situation. 

The reasDns for eUniinQting clopot^ froni fuv^/^^^y riocu^'iuii^d - 

tion study are: 

1. The nature of the work is qualitatively dlffnrynt from work per- 
formed at other maintenance levels. Depot Tnai^'^tenanco consists 
largely in fabrication, not^aasily procedural i ^ed. (Mote that 
this fabrication is not a characteris t1c of any ons Cornmod i tj/ 
System, but rather of the depot ecHelon in general.) 

2. Large variations in speciric work procedures exist across depots, 
dictated by available equioment and local SOP't. 

3. Depot persorinel are primarily ci vi 1 ians wi th long experience. 
They perform the same assenibly and di*'s assembly prDcedures and 
need TMs only when switching to a new job situation, 

4. Depot operations, account for only a small fraction of total 
ownership costs. To address specific depot problems wouTd not 
be cost effective. 

It should also be noted again that the specification that will be 
□ roduced in Task 5 could be applied to certain depot activities (e.g, , 
assembly processes). '* , 
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APPENDIX F 

FIELD TEST PLAN 



I. , SCOPK . :. 

This;, ffiport rnvers the rievelopnient of a field test T'^m for evaluating 
cost erfectivsnpss of the prototype information presentat10i,/tranS'miss1ons 
packaqe develope'i in Task 5, ' ■ 

II. OBJECTIVES 

The objecti ves of this task were to develop a field test plan which 
would evaluate the prototype information package in ternis of cost, 
user effectiveness, and uLer'-acceptabi 1 1 ty. 

HI. APPROACH • ■ 

ill 

Many tests have been conducted on the new concepts over the past twenty 
yeans. It is in stryct1\re to_look at their strengths and v/Ml<nesses as a 
^'background for thc^ pnoposed Test Plan. . 

, 1. ya1-ijnj_Qj Jesuits 

T^o comrriuni ties with the same goals have different Qflteria for believ- 
ability or validity. Ihey nre the research and the fnllitsry comnunlties. 
The fTiil Hary coraum'ty believes in tests that are close to the everyday 
mili tary. envi ronment and involve the judgement of. milttgry observers who. 
are intimately familiar with that environment* The research community- 

believes t&sts that are highly controlledg repeatable,. end are 
independent'Qf the (presumably biased) opinions of any observer, mnitary 
or scienti fic , experienced or inexperienced. The grounds for cornnon 
.expectations fron] these cofnniun1t1es is that the test environment should 
look something like the operational environment, .But the T^search person 
will sacrifice siniilarity for the sake of control and repeeitebni ty and 
the military person will sacrifice those ■ cri teria for simiUrlty to field ' 
condi ttons, The research person will agree to observer ^v^Tuation^s only 
if the criteria for what category to place an observation in is so well 
defi ned, that virtuany anyone can make the same VcorreCt" judgement* 
The military person will eschew "reliability and objectivity" for an 
observer who cm evaluate a given performance in terms of other performances 
he has seen In simi lar circunistances , In effect, one is Jaoking for an , 

evaluation while the other is looking for an observatloin . 

To provide a believable and valid test for those ir both communities, 
the Test Plan integrates a tightly controlled three weeK test with a . 
•nine month field condition test. 
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Wh&r^ p^r'SOriDei ^ reaeive an experimental treatment , 1 1 1 s generally on 
a "one st^of' or ^ excJ^^Pt^on basis. That Is, after the test ? the ."guinea 
piqs^' ah^nD^gi yen the job ^or which the expeh'menta 1 t^'eatment mm 
designed to prep tliemi, This kind of future has general! j been no secret 
to the "guinea p Igs'" Et is easy to see that people v/orWng under sucN 
conditlQris canno t h^ve the sefne motivation as those wfio can expect to 
achieve the Job goal , On the other hand ^ the conclusion that an €xper1 v 
mental Pr^ogbam v#'i 11 procduce personnel as job quail fied as the ^radition^al 
progr-ain C treatme iit) Is difficult to accept before the test. When the ^ 
differences ti^ea^mencs are qu-f te different^ e*g,, proved ures versus 
undersUn-dihSf i t i^ ver^y di ^'^ficult to give the job duty to- an eKperiine^ntal 
person pr^ep^r^ed the "otMer v/ey'^ 

The propose t| T^st plan nncludes a provision for most test ^subjects to 
be inco^^pora^ed Inttsi the regiJlar unit operation after the testing is 
complete, . , 

3. teh^e .o tjy^^^^^ Maintenance \. ^ . -- z^; 

- En a. contfo- ll6£jl: research study s malfunctions are artificially inserted 
into the equ^p»1it; Troiibleshooting and non-troubles hoo tin g task:^ are 
selected on -Chi.^apf s'tf-psoine cri teria that are intended to identify a 
^ range of tasNs ^at- 4re represeritative of the real world- Advantages to 
J^hnV^.^ipr'oacM .ar4 tK^at 1^^^^ of d1 fferent tasks can be run i n a short period 
unaeV rat-he^ clo'4e ^pr^imental controW But naintenance personriel do no"t 
Dor^iHaTly ^ fuhtttio rt] 6fie a- compressed time. scale^ Nor do they normal 1y 
encounter nil'Snte nianc^e t»^fc in the frequencies used in a controlled test, 
. (SoiDe exp erlnffiant:^ oyt ly ^ail once or tvwice a'year. ) Maintenance per'sonn el 
My perfp rfit ane lyp^.of task almost daily and^ another hard! j ever or 
not at ai 1. ' ^ . -H:-- , ^ 

. The ./propose ft| st plan allows both a compressed and controlled test, 
to collects wid^ r^.fige of Iriforrnation qufckly and efficiently^ foil owed 
iy an op© ratflona 1 ft^ l^ov^^up. that pni tors mai activ ities as thej 

cccun during the ]o^0 term cour-se of -norma V operations, 

The ^erieral puy^-pos^ of the Test Plan is , to evaluate a new document-atl on 
package^ 1t^ str^ng^^hs aLjd.weaknesses ^ its costs and effectTvenesSi- and its 
acceptabi Htyto th^-"tar"|et user population. The specif fcatiori froni i^h ich 
It \^|& de^eloiped wi^ 1 b©- 'part iall j val idated because 1t;was thesource-cf 
the irnpleiiienced <locu3iient-at1on package. 
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^ To this end, it 1s important to identify and collect information on 
all aspects of the documertsti on' s opefational use. Results will be used 
to justify decisions regarding' the Implementation of the documentation 
package. Recomniendati ons must be based upon good research .design data as 
v!/«n as -sal iert. military considerations. 

2, Goal s , ■ 

The purpose of the test may be stated in terms of three general goals, 
relaUng to costs, effectiveness, and acceptability. 

a Costs- Cost is the most iniportant test' dimension. There is a 
potential"rifuct1on.of 1.7 biTHon dollars annuany in the cost of Army^' 
equipmnt ownership that Can be effected by new types of technical document 
tation. Maintenance costs is the key-to reducing life cycle ov/nership 
costs Tlie Test Plan must generate accurate data that can be used, to ■ 
project. cost savings acM «vable -from adoption of the documentation pacKage, 

b Effe etiveriess : At though costs are of primary concern , the docu- 
mentation package niEfit also be tested for Its effectiveness in the^ha^ 
of the intended users, Consequently,^data will be collected on the levels 
of. skill demonstrated by personnel nialntaining the equi pment under the . , 
duidance of the documentati on^^package , with respect both to individual 
Iffectiveness.and overall manpower utilization (group effectiveness). 

' _ 

Effectiveness data will be reported separately. _ Where possible, 
however,. thess data will be translated into cost estimates as well. (For 
instance, when effecti vemss^ or job production is increased by 50%, this 
can be translated into reduced personnel or Into increased readiness pt 
capital equipment. ) . 

c Acceptability: tjhenever a new innovation is introduced, there 
Is 'danger that It will be disrii ssed' out of hand, just because it is new, 
independent of its value in reducing costs .or improving effectiveness. 
Consequently, a third goal of the Test Plan is to collect infcir^ation on 
the acceptability of .the new concept • to its intended users and. to the 
Army Commanders responsible for training and staffing, as the documen-^^ 
tation package accepted'on its face or is an indoctrination or , wfpning 
• phase required? Is it imnediately preferred over the existing package 
or does it depend heavily on prior experience with traditional fornis of 
docunientation? Is it Trtrnedifftely acceptable to new users (new personnel to 
the Army)? \ ' ^ 

3. Obiecti VeS ■: 

Objectives beafing on these goals include but are not limited to the 
following: ■ to . 

liO 



a, Costj 

(1 ) Dev^elopment 



Determine absolute costs pf package develcpment, e:itifnat;ed 
Separately for: - . . 

Q content analysis 

' 0 materials preparation ' ' = 

' -.^z 0 materials production ; " 

0 materiais reproduction, distribution and display' 

■ ' . Compare these costs with tests associated with curv^ent 
documentati on . 

(2) Training ' ' . 

Estimate savings in training costs., per user (trainee) ^ 
relative to standard training costs. ■ . 

. (3 ) M^i ntenance 

Estimate savings in maintenance costs attriblitable to Towered 
incidence of repl aclng- good parts* especlany non-expendable parts ; and 
savings frorn Increased manpower utilization. . . . 

b. Effectiveness . :\ 

( 1 ) Producti v1 ty - 

Estimate Increases 1n user productivity, as measured by timS 
to successful completion of maintenance taskSs or user idle time,, under 
alternate manpowr configurations, ■ ■ . ^ 

(Z) Readiness . ^ - - . 

Estimate increases in prime equipment downtime attributable 
to slow or ineffective maintenance. 

c^ Acceptabil ity . 

Estimate " preferences for the dqqumentatlon package over existlng^ 
guidance^ by novicss. trai nees^ users, thei r ■ supervisors , and. comnianders , 
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rv. RESULTS 



The Droposed Test Plan \H 11 evfxluate the prototype information package 
covering the Armanient Subs^^stein of fhe M50A2 tank^. The testing win co^er 
a representative sample of tasks ir^ the prototype package and corresponding 
tasks in the following Technical Manuals. 

0. ^ TM 9-2350-232-20/2 - M60A2 Turret Organi^ationaT; Mai ntenance 
0 TM 9-2350-232-34/2 - M60A2, Turret Direct and General Support 

Maintenance 

0 TM 9-1 240--365-34 - Laser Range Finder General and Direct . 

Support Mainitenance 

A. • Design ; . ' . 

The Test Plan is divided into three phases: 
Preparation 

^ Experimental Phase - * - ' 

Operational Phase . i 

The Experimental Phase consists of a Gontrol led research 'study lasting 
approximately three vveeks. . * . 

The Operational Phase is a long term (approximately nine monthsf 
follow-up to colTect data under normal operational conditions. 

This general approach is intended to satisfy both research require- 
ments (Experifnental Phase) and mil i tar/ requirements (Operational ^Phase) , 
It treats subjects (users) more as professionals than as guinea pigs^ 
because all subjects will be allowed to perf brm.j n^ jobs for which they were 
trained (at. least over the nine month period). 

,\ ' 

Since preparation activities are dictated by the designs for the 
Experimental and Operational Phases, the discussi on below 1s presented in / 
the follov/ing order:' 

Experimental Phase " -. 

Operational Phase 

Preparation^ ^ . 

■ ' 1 , Experimental Phase 

Test objectives require an evaluation 1n both absolute and relatlye^ 
terms. For example / absol ute data incltides raw dollar costs of analyzing 
the equipments, clock hours required to return equipment to operational 
status, and so on . Relative data, on the other hand, requires a coniparlson 
standard. For.exainple^ how much training. tl.nif 'i^ tea ved rel ati ve to current 
practices? How high Is productivity ralative to gxi sting standards ? 
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Comparison standards rare available in the 11 ter£,rjr_e, but only in 
rough form (e,g. , 85% of non-^expendable parts returned to the depot as 
bad are tested and found to be good), and none are available for the 
specific equipments^ to be tested. ' ' 

Consequently^ the design calls for a comparison of users maintaining 
equipment with and v/ithout the new package. 

a- Subj ects , / • 

Data collected during the experimental phase will be used to establish 
■two groups j an Expiriniental Group and a Control Group. Each group will 
be subdivided into novtces, apprentices and journeyrrien as defined below: 

Novice; No eKperience maintaining the target equipment or 
coinparable equipment, i.e., BCT grdduates. 

Apprenticej Less than 6 months experience or Techni cal School . 
- graduate - no experience ^ 

Journeyman: More, than one year's experience 

Novices, apprentices and journeymen in the tw p'roups will be matched 
for important characteristics ^ e.g., months experience. The Experifnental 
Group v/in include at least 15 novices,- 15 apprentices, and 15 journeymen 
The Control Group wil 1 contain equal numbers of subjects in each category. 
An subjects will be' working under their primary MQS, and will be picked 
for their 'availability during the Operational Phase. Soine personnel from.^ 
the Experimental Phase v/111 be available for the Operational Phase, others 
will not. Those that are should be utilized; iidditional personnel should 
then-be added to bring the nurnbers in each group to the specified levels* 

b. Treatments 

All sijbjects will be administered training as required and defined by ^ 
the prototype package,, but only as necessary and appropriate to the docu- 
mentation to be used. Xt should be noted here that the prototype package 
is designed for the novice and should severely reduce the training require 
ment. thuSs the training will be Timited to accesf tasks, use of special 
tools and test equipfnent, etc. 

Following trainingi subjects will be asked to perform maintenance tasks 
as directed'by test personnel* These tasks win be pre-selected^ from the 
prototype package for such criteria as: / 

Non-Troubl eshooting ^ ■ = 

\ ^ ^ • ■ ^i 

* (1) All niaintenance missions will be covered (preventive, remove 

and repl ace assemble/disassenible, align and adjust, etc). 



(2) A wide range tool/test equipment usage will be required. 



. Troubleshooting ; . " ■ ■ . . 

(1) Malfunctions inserted will require a range of isolations to 
each of the passible levels (module replaceinent to piece part). 

(2) Malfunctions insei^ted will require a^wlde range of test ■ 

equi pment . ■ ' • 

c- Measures . ■' ■ ^ 

Data v^m b'e conected during test administration as required to 
accomplish costand effectiveness objectives. Acceptance data w]] 1 be 
coriGcted via interview and questionnaf re methods at the termination of 
the Experinnental Phase'. 

2, Operational PhaA& ' ' . , 

- The critical feature of the Operational Phase Is that 1t be represen- 
tative ofthe "real world". For example: ' 

The equipment should be in service under conditions for which^it was 
intended. Thus, malfunctions should be those normally expected under 
typical usage. No malfunctions will be artificial 1^ inserted . 

Similarly, the maintananw environment should be the regular opera- 
tional environment except for the ..special documentation and possible 
special tests and record keep Ing. 

Finally, the personnel themselves should be typical of the type of 
personnel expected to routinely maintain the equipment. 

To the extent that these assumptions are unmet, the fi nal, results are 
"impure" projections of v^at W expect beyond the test enA/i ronniemt. , 

Consequently, it is important- that measures taken on the two groups 
during the Operational Phase be as ■unobtrusive as possible. To^thrs end, 
documents ro utinely generated' in performance of maiotenance tasks will be 
re ieS to identify data bearing on differences between the tv;o groups 
and subgroups. These documents will be analyzed dunng the experimental phase 
Siniple procedures will be implemented during- the lOperational Phase to 
-"capture data elements identified as relevant, ^ 

' - Test administrators will visit the test site binionthly to confirm 
that data collection procedures are being .Implemented properly, to 
collect accumulated data, and to refine measures as, necessary. 

' Since equipment breakdowns will be taken as thiy narmally occur, 
the Operational Phase may have to continue for severe! nionths before 
■ sufficient data are' aval lable to justify conclusions and recoinmendatTQns. 
This Phase will be terminated as soon as sufficient data are collected, 
In no event will it run longer than nine months. 



3, Preparation 

a. |xper1 mental Phasp 



To prepare for the Experimental Ph«se^'test adrhinistrators ml) 
■select and Justify mai nten^tice tasks 1n terms of criteria stated earlrer. 
Detail ed. measures of these/tasks ml] be identified or deyelopea. Including 
■ data collection, data reduction, and data analysis techniques. All planni'rig 
will be^ carefully coordin^ated with local sypervlsors and commanders/ 

Data necessary to e/tablish the Experimental and Control Groups and 
subgroups will be furnished by the test administrators. At minimum, 
subgroups in the Experi^mental and Control Groups v/ill be niatched for sub- 
group mean nionths reTe>/ant experience (on the target equipment or 
comparable equipment). 

' ' "r ^ ' 

Site preparation for the Experimental Phase will begin on arrival at 
the test site at lieast one w: ek in advance of formal testing. Important 
t^sks incl ude : 1 

(1) secun'e the CDOperation of local persDnnel . ■ 

(2) becoFne thoroughly 'fami liar wi th local maintenance 
environments and conditions . 

(3) dry run and debug specific measures to =be employed. 

b ^ Operational Phase^ ^ , 

Test adtninlstrators wi n . review 38-750 (TAMMS) to" identffy oppor- 
^tunlties for monitoring naintenance activities in terms'of routine forms, 
'Plans for unobtrusively collecting information in this manner ^fll be 
confirmed during the Experimental Phase^ Additi onal measures v/ill be 
developed only as necessary. 

Plans for data collection during the Operatibnal Phase ^111 be 
coordinated with cognizant personnel, ^ 

B. Mta^Rg P-prti.ng and Analysis " ^ 

■ 1 . ^ er jmen t a 1 Phase 

Data collected during EKperimental Phase testing will be analyzed-to 
determine the effectiveness of the prototype package as cbmparecf to the 
conventional Technical Manual, This analysis will be in terms of 
successful completicn of tasks^ time required to perform tasks,, and 
mistakes and problen]S encountered. These data can be used to deterfiilne ■ 
cost effectiveness in terms of personnel utilization? impact on training,. 
'&nd on maintenance costs and productivity. The anticipated savings' accrued 
here can then be compare'd against the cost of the development of full scale 
manuals under the new concept/ " ^ . , 
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2- Operational Phase 



The data conected during this phase can be used to update the pro- 
jections developed during the Experimental Phase. These data represent 
the "real world" and as such should form the basis for broader imple- 
iTientatlon of the new concept. , . 

TRere are three forms of data which can be collected; during the ' \ " 
Operational Phase.^. The first type of data is that of operational ^ 
readiness of the major equipments to which maintenance of the subcom^ 
ponents contributes. If the group using the new, manuals is of sufficient 
size to conduct maintenanceof all subcompdnents of an identifiable group 
of equipments /' then the material readiness of ^ that group of equipments can 
be used as admeasure of the effectiveness of the personnel doing the 
maintenance. 

However, if the group. Is not large enough or other operational con- 
straints make this. form of data collection rmposslble, a second form may 
.foe used. Records would be kept on the individual items' maintained^ 
rather. than on the major Items which the maintenance contributes to.;^ 
These individual itenis would be the norinal "work units" assigned fay th^ 
job supervisor. The Jobs, are Identified in the MAC Chart (which is' callGd 
■a Tas kMdenti flcation Matrix In Air Force terminology). The records kept 
would include the man hours expended in accomplishing the maintenance tasfes^ 
assigned by the job supervisor. The effort expended by those Using the new 
documentation and those using traditional documentatlon/would be the basis 
of comparison. ^ (This measure is'iavallablle even if both groups of personnel 
work on the same major equipment items 0 \ ; , ;i v ' , 

A third form of data would be statements from job supervisors. These 
would not be general op1n>oa statements^ but would be^speclfic to events 
which occurred. The supervisor will be asked to cite spectflcs in his 
statements on hov/ well personnel performed their jobs. He will be asked to 
state why he failed to assign certain jobs to members of either group 
artd why. This data form is intended to be more objective than the usuaT 
opinion gathering survey. It is intended to use his judgement about job 
effectiveness appTle'd to specific situations which he observed. It is 
not a global impression measure of '-pure opinion. 
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